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NEWHOUSE PHENOMENA IN THE FIBONACCI TRACE MAP 


WILLIAM YESSEN 


Abstract. We study dynamical properties of the Fibonacci trace map - a 
polynomial map that is related to numerous problems in geometry, algebra, 
analysis, mathematical physics, and number theory. Persistent homoclinic 
tangencies, stochastic sea of full Hausdorff dimension, infinitely many elliptic 
islands - all the conservative Newhouse phenomena are obtained for many 
values of the Fricke-Vogt invariant. The map has all the essential properties 
that were obtained previously for the Taylor-Chirikov standard map, and can 
be suggested as another candidate for the simplest conservative system with 
highly non-trivial dynamics. 
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1. Introduction 

In this paper we study the dynamics of the Fibonacci trace map 

(1) T : K 3 —5>K 3 , T(x,y, z) = (2xy - z,x,y). 

This map appears naturally in representation theory and geometry [7,37,68], anal¬ 
ysis and mathematical physics (see [1,13,54] for surveys of old and recent results on 
applications in aperiodic lattice models, [ ,70,7 ] for quantum kicked systems and 
quantum walks, and [7,8,47] for applications to Painleve VI equation), and number 
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theory (see [5,71] for applications to Markov triples). Let us briefly describe some 
of these connections, and set the stage for our main result. 

Consider the free group F 2 = f (a,/3). Let Rep(F 2 ) denote the set of representa¬ 
tions of F 2 into SL(2,C). The group SL(2,C) acts on Rep(F 2 ) by conjugation, and 
for all p £ Rep(F 2 ), the traces 

x = f Tr(p(a)), y d = Tr(p(/3)), z d = Tr(p(a/3)) 

are preserved under the action. We obtain a bijective correspondence p K > ( x , y , z), 
p £ Rep(F 2 ), between the algebraic quotient Rep(F 2 )/SL(2, C) (where SL(2,C) 
acts by conjugation) and C 3 (for details, see, for example, [37]). Now if Aut(F 2 ) 
acts on Rep(F 2 ) by composition, then this induces an action on C 3 by polyno¬ 
mial diffeomorphisms (see [68] and references therein for further details). These 
diffeomorphisms are called trace maps. 

It turns out that the trace of the commutator [p(a), p(/3)\ is invariant under 
the associated trace map and this leads to the Fricke-Vogt invariant , the cubic 
polynomial 

(2) I{x,y, z) = x 2 + y 2 + z 2 - 2xyz - 1. 

Therefore it is natural to consider the cubic level surfaces 

Sv = {( x,y,z ) | I(x,y,z) = V} 

that are invariant under the trace maps. 

By studying the dynamics of trace maps, Cantat in [7] was able to give a detailed 
description of the dynamics of mapping class groups of the once punctured torus and 
the four punctured sphere. For example, in the (simpler) case of the once punctured 
torus, Ti, we have 7 Ti(Ti) = F 2 (the loop around the puncture corresponds to the 
commutator [a,/3]). Then the action of Aut(F 2 ) on Rep(F 2 ) induces an action of 
the mapping class group MCG*(T 1 ) on C 3 . Using the invariance of Sy, for each 
fixed V £ C we obtain a morphism from MCG*(Ti) to the group of polynomial 
diffeomorphisms on Sy (see also [35,36]). 

In analysis, trace maps have been useful in the study of the Painleve VI equation 
(see, for example, [7,47]). 

In physical applications, trace maps arise as renormalization maps in the spec¬ 
tral theory and the statistical mechanics of one-dimensional quasicrystal mod¬ 
els, quasiperiodically kicked systems, and quantum walks. In this context, one- 
dimensional quasicrystals are modeled by endomorphisms (and, more often, auto¬ 
morphisms) of F 2 (for a short exposition, see, for example, [1]). For example, the 
widely studied case is given by s £ Aut(F 2 ), s{a) = ab, s(b) = a, which leads to the 
trace map (1). Then a one-dimensional quasicrystal consisting of two ’’atoms” is 
represented by the infinite sequence obtained from the infinite repeated application 
of s: 



n times 


lr The Fricke-Vogt invariant appeared first more than a century ago in the results of Fricke- 
Klein and Vogt in a similar context; see [31,32,76] for the original works, and [37] for a modern 
exposition. 
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Given a model, it turns out that there exists a representation 

P : F 2 —>- SL(2,C), 

such that much of the relevant physical information about the model is encapsulated 
in the traces of the matrices p(s ra (o)), n £ N. Moreover, one is often interested in 
the limits as n -> oo, which comes down to the dynamics of 

Tv=T\ Sv 

for various values of V eK(K = MorK = C depending on the model in question). 
This method has yielded great progress in the past few years (see [10,49,59,75] for 
the classical results and [14—18, 20-24, 30, 53, 54, 79-81] and references therein for 
the more recent contributions). 

The Fibonacci trace map belongs to a class of trace maps displaying the richest 
dynamics (see [7]). This class consists of trace maps associated to those automor¬ 
phisms s £ Aut(F 2 ) that satisfy the condition that for some k £ N, both ’’words” 
s k (a) and s k (b) contain the ’’letters” a and b. In turns out that the dynamics of the 
trace maps from this class is qualitatively the same. Perhaps for historical reasons 
(see [10,49,59]) authors often choose the Fibonacci trace map as a representative 
example of this class. 

In many physically motivated problems only maps {TV} that correspond to 
real and positive values of the Fricke-Vogt invariant are relevant (although in [80] 
complex V had to be considered in connection with some models in statistical 
mechanics). For example, in many of the aforementioned papers by Damanik et. 
al. where the Fibonacci trace map (1) is used to study the spectral properties of 
the Fibonacci Hamiltonian (one of the most prominent one-dimensional aperiodic 
models), the map T \2 is ’’responsible” for the spectral properties of the operator 

4 

with the coupling constant A. 

The dynamics of the maps TV for V > 0 is completely understood. It is known 
that the set Ay of bounded orbits (in forward and backward time) of Ty for V > 0 
coincides with the nonwandering set and is a totally disconnected topologically 
mixing compact locally maximal hyperbolic set [7, 10,16] . As a consequence, points 
that do not escape to infinity in forward (backward) time are precisely those that 
form the stable (unstable) lamination. All other points escape to infinity either in 
forward or backward time (or both) depending whether they lie on the unstable 
but not stable, or stable but not unstable (or neither) lamination, respectively. The 
escape rate of points is superexponential, and escape regions have also been studied 
[67]. The topological entropy 

htopiTy ) = log ——— 

is the same for all V > 0 [7]. Also, it is known that 

(3) lim dim H Ay = 2, see [18], and 

V->0+ 

(4) lim (log V) ■ dirriH Ay = 41og(l + y/2) , see [14]. 

V —>+00 

For V = 0 the corresponding surface So, called the Cayley cubic , has four conic 
singularities, 

(5) Pr = (1,1,1), P 2 = (-l,-l,l), P 3 = (l,-1,-1), P 4 = (-l,l,-l), 
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(a) V < 0 



(b) V = 0 



(c) V > 0 


Figure 1 . Plots of the Fricke-Vogt invariant surfaces for a few values of V. 


and is smooth in other points. For V > 0, the surface deforms into a topological 
sphere with four punctures (see Figure 1 (b)-(c)). 

For V < 0, define 

(6) Sy d =5 v n[-l,l] 3 . 

Sy is nonempty for V > — 1, and is invariant under Ty. The map To restricted to 
the central part of the Cayley cubic, So, is a pseudo-Anosov transformation, and is 
a factor of the linear automorphism of the torus generated by the hyperbolic map 

m 4=(; J). 

The factor map is given by 

(8) T(0, <f>) = (cos 27 t(6 + </>), cos 2n9, cos 2i r</>). 

For V £ (—1,0) the surface Sy consists of five connected components (see Figure 
1 (a)), one of them, Sy as defined in (6), is diffeomorphic to the two-dimensional 
sphere, and is invariant under the map Ty, and four others are non-conrpact, dif- 
feomorfic to a disc. At V = — 1, the bounded component degenerates into the point 
at the origin, and for V < — 1, the bounded component disappeares completely. 

Dynamics of the trace map on the unbounded components is trivial: every orbit 
escapes to infinity under both positive and negative iterates (it should be men¬ 
tioned, however, that a famous open problem on Markov triples—the so-called 
Frobenious Conjecture —can be reformulated in terms of properties of some orbits 
of a semigroup generated by some trace map acting on the unbounded components 
of Sy; see [5,71] for details). 

In this paper we study the dynamics of the map Ty restricted to the compact 
component Sy, V £ (—1,0). This regime appears naturally in the models related 
to quantum walks in aperiodic media and quantum aperiodically kicked double 
rotators (see, for example, [70,74] and a short review in [1, Section 5]) 2 . 

Notice that T preserves the Euclidean volume. Then for any Vi, V -2 £ (—1,0) 
with Vi < V 2 , T restricted to [Jye(Vi a ^ so P reserves the Euclidean volume, 

from which we see that for all V £ (—1,0), there exists an analytic area form on 

2 Kicked rotators are also sometimes called quantum standard maps as they relate to the 

Chirikov standard map, discussed below, and were first studied in [9]. 
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§y that is preserved by Ty and is analytic in V. Thus all the questions typically 
asked about (families of) low-dimensional conservative (and, in our case, analytic) 
systems can be asked about Ty. 

Periodic orbits of the Fibonacci trace map Ty (and other trace maps) for V < 0 
were studied in [45,46]. In the physics literature relating to the dynamics of Ty, 
V £ (—1, 0) as it connects to the aforementioned models ([ 0] and references therein, 
[74]), the results are numeric and suggest a mixing phenomenon similar to the one 
observed in the well known standard map (which we discuss in more detail below). 

1.1. Statement of the main result (Theorem 1.1). In this paper we prove 



Figure 2. Poincare sections showing orbits of the Fibonacci trace map 
restricted to §v for various values of V <0. 


Theorem 1.1. There exists Vq £ (—1,0) such that for all V £ (Vo,0), the map Ty 
has a locally maximal compact hyperbolic set A y in §y with the following properties. 
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(1) The sequence {Ay} is dynamically monotone; that is, for V 2 > V\, Ay 2 
contains the continuation of A y 1 . 

(2) The Hausdorff distance from Ay to So tends to zero as V tends to zero. 

(3) The Hausdorff dimension of Ay tends to two as V tends to zero. 

(4) Ay exhibits quadratic homoclinic tangencies that unfold generically with the 
parameter V. 

Moreover, there exists a residual set 1Z C (Vo, 0) such that for all V £ 7Z 
the following properties hold. 

(5) The map Ty has a nested sequence of invariant totally disconnected hyper¬ 
bolic sets A[?■* C A^ C • ■ ■ , with Ay) = Ay, and the Hausdorff dimension 
of Ay) tends to two as n tends to infinity. 

(6) The set fly = [J ngN ^-v' > a transitive invariant set ofTy whose Hausdorff 
dimension is equal to two. 

(7) Each point of fly is accumulated by elliptic islands of Ty. 

Plots of some orbits of Ty for various values of V are given in Figure 2. It is 
apparent that for values of V close to —1, most of the phase space is laminated by 
invariant circles. As V increases, elliptic islands survive, but the stochastic sea (i.e. 
the set of orbits with positive Lyapunov exponent) ’’floods” the phase space. In 
Figure 2 (d) it looks like the chaotic sea fills most of the phase space completely; 
this is not the case, as Theorem 1.1 (7) asserts, but its Hausdorff dimension indeed 
increases to 2, and it indeed approaches So in the Hausdorff metric. 

1.2. Comparison with the Taylor-Chirikov standard family. It turns out 
that the dynamical properties of the family of maps {Ty}y g (_yo) are extremely 
close to the dynamics of the famous standard family (see [27, 39] and references 
therein). The main open problem in the modern low-dimensional conservative 
dynamics is existence of the mixed behavior for analytic symplectic maps (see, for 
example, Section 6 in [63] and notice also the reference to automorphisms of K 3 
surfaces introduced by McMullen in [52] as another set of promising candidates). 
Mixed behavior means that together with a set of positive measure filled by the 
invariant families of elliptic curves (existence of this set in many cases is guarantied 
by the KAM theory) the stochastic sea also has positive measure. The classical and 
most famous specific system in this context is the standard family given by 

(9) fk(x, y) = (x + y + ksm(2nx), y + k sin(27ra;)) mod Z 2 . 

It was suggested by Chirikov [11] (see also [12] for an extended exposition and 
[48, 72] for further discussion on the underlying physics) and Taylor 3 in the 1960s 
as a description of some phenomena in plasma physics, and also due to relations with 
the Frenkel-Kontorova model [50]. Sinai conjectured that fk has positive measure- 
theoretic entropy for many values of the parameter k > 0 [73] ; due to Pesin’s theory 
[64], this is equivalent to the conjecture that fk exhibits mixed behavior. 

In [39], Gorodetski proved the following theorem 

3 The British physicist J. B. Taylor was among the first to study the model, but the reports 
were never published. The first occurance of the term ” Chirikov-Taylor map” traces back to [51]. 
” Taylor-Chirikov map” is also a name given often to the standard map. 
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Theorem 1.2 (Gorodetski 2012). There exists ko > 0 and a residual set TZ C 
[fco,oo) such that for every k £ TZ there exists an infinite sequence of transitive 
locally maximal hyperbolic sets of the map fk, 

Ai 0) afc-afc... 

that has the following properties: 

(1) The family of sets l > is dynamically increasing: for small e > 0, 

l J /c>fco 

A^ e contains the continuation of A^ at parameter k + e; 

(2) The set is Sk~dense in T 2 for 6k = p 73 >' 

(3) The Hausdorff dimension dimn(A^"' ) ) — > 2 as n —> oo; 

(4) f Ik *= f UngNA^”"* is a transitive invariant set of the map fk, and dimn(f 2 fc) = 

2 ; 

(5) For any x £ flk, k £ TZ, and any e > 0, the Hausdorff dimension 

dim H (S £ (a;)) ("10*= dim H (n fc ) = 2, 

where B e {x) is the open ball of radius e centered at x; 

(6) Each point offlk is an accumulation point of elliptic islands of the map fk- 

The family of hyperbolic sets |a^| that satisfies properties (1) and (2) was 
constructed by Duarte in [27]. He also showed that 

dimn(A^) -a 2 as k —> oo, 

and that for topologically generic parameters the set A^ is accumulated by elliptic 
islands. For an open set of parameters, Gorodetski’s theorem provides invariant 
hyperbolic sets of Hausdorff dimension arbitrarily close to 2. Namely, the following 
theorem was also proved in [39]. 

Theorem 1.3 (Gorodetski 2012). There exists ko > 0 such that for any £ > 0 there 
exists an open and dense subset U C [fco,oo) such that for every k £ U the map 
fk has an invariant locally maximal hyperbolic set of Hausdorff dimension greater 
than 2 — f which is also Sk-dense in T 2 for 8k = ^173 • 

Notice that the properties of the family (9) that are outlined above also hold for 
the trace map Ty as the value of V approaches 0 from below (compare Figures 2 
and 3). Essentially all the questions about the standard family can be reformulated 
for the family {Ty}, and one must face the same difficulties in studying {Ty} as in 
studying the standard family. 

Theorems 1.2 and 1.3 for the standard family, and Theorem 1.1 for the Fibonacci 
trace map explain the difficulty associated with proving positive measure of the 
stochastic sea, as outlined in the introduction of [31]. Namely, one way to ’’inflate” 
the stochastic sea is to extend a hyperbolic set to a larger portion of the phase space 
through homoclinic bifurcations by varying the parameter of the family. On the 
other hand, small changes in the parameter create Newhouse domains leading to 
loss of hyperbolicity (see [38,55,56,58,69] for the dissipative case, and [26,28,29,40] 
for the conservative case). Then one could try to prove that the set of parameters 
for which Newhouse domains appear is in some sense small. Indeed, when the 
Hausdorff dimension of the initial Cantor set is smaller than one, the measure of 
the set of parameters corresponding to Newhouse domains is small and has zero 
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(a) k = 0.4 



(b) k = 0.8 



(c) k = 1.5 



Figure 3. Orbits of the standard map for various values of the parameter k. 


density at the critical value [57,60] (in our case the critical values are k = oo for 
the standard map and V = 0 for the trace map). When the Hausdorff dimension 
of the initial hyperbolic set is slightly larger than one, Palis and Yoccoz in [62] 
give a similar result. They also conjecture that the result should hold for initial 
sets of arbitrary Hausdorff dimension, but for this their methods would need to be 
significantly sharpened (the proofs in [62] are already extremely intricate); see the 
last paragraph on p. 3 of [62]. Now we see that if one is to follow this approach, 
given Theorems 1.2, 1.3, and Theorem 1.1, one must work through these difficulties. 

1.3. Simplest candidate for a map with mixed behavior, and some related 
questions. Of course, as mentioned above, the main question associated with the 
standard family (and one we can ask about the Fibonacci trace map) is about the 
measure of the stochastic sea. One could ask more generally the following question 

[6,78]. 
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Question 1.4. Does there exists an analytic symplectic map of a connected mani¬ 
fold with coexisting stochastic sea of positive measure and the KAM tori? 

Examples of C°° maps with such behavior are given in [6,25,65,77]. Some 
analytic non-uniformly hyperbolic maps on surfaces have also been shown to display 
this type of behavior [7,33,34]. To this day, however, no example of a real analytic 
symplectomorphism with mixed behavior has been given. 

We believe that the family {Ty} can be suggested alternatively to the standard 
family as a ’’simplest canditate” for an analytic symplectic map with mixed behav¬ 
ior; it also has the advantage of being a family of polynomial maps, so there is a 
chance that some of the advances in polynomial dynamics (as in [2-4], for example) 
could yield a better understanding of its properties. 

The following question has been posed to the author by John Franks. 

Question 1.5. Is the set of periodic points ofTy for V < 0 dense in Sy ? At least 
for all V < 0 sufficiently close to zero? 

We believe the answer is yes, at least for all V < 0 close to zero. The techniques 
of the present paper do not yield this result. We should mention that the periodic 
points of T v , V < 0, and other trace maps have been studied in [ 5,46], but 
the density question remains open. The main problem is that while every periodic 
point can be continued from So to Sy for V <0 close to zero (due to hyperbolicity), 
it seems hard to prove that densely many of them can be continued in this way 
uniformly. The reason for this is that many periodic points become elliptic as they 
are continued along V. If p is an elliptic periodic point on Sy 0 , Vq < 0, then p 
undergoes a period doubling bifurcation in V for V > Vo, bifurcating into two 
hyperbolic periodic points. 

Acknowledgment. The author is indebted to Anton Gorodetski for suggesting 
this problem, and for a number of very helpful discussions. 


2. Proof of Theorem 1.1 


2.1. Construction of locally maximal hyperbolic sets of large dimension. 

We begin with construction of compact locally maximal hyperbolic sets on So of 
large Hausdorff dimension. More importantly (as this will be used later in the 
proof), large Hausdorff dimension will follow as a consequence of large thickness, 
r, due to the following relation 



( 10 ) 


(see Chapter 4 in [61]). 

Before we continue, let us recall the definition of thickness (for further details, 
see Chapter 4 in [61]). Let C C R be a Cantor set 4 and denote by / its convex hull. 


Any connected component of I\C is called a gap of C. A presentation of C is given 


by an ordering U = {U n } n > l of the gaps of C. If u £ C is a boundary point of a 
gap U of C, we denote by K the connected component of / \ (U\ U U 2 U ... U U n ) 


4 By a Cantor set we mean a nonempty compact perfect set with empty interior. 
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(with n chosen so that U n = U ) that contains u and write 

t(C,U,u ) = 

With this notation, the thickness t(C ) is given by 

t(C) = sup inf t(C,U, u). 
u u 

Lemma 2.1. Fix cq > 0 small. For all e £ (0,eo], there exists a compact totally 
disconnected locally maximal hyperbolic set T e C So (away from the four conic 
singularities) such that 

(11) for all ei > 62 , T ei C T £2 , 
and for any periodic q £ T e , 

(12) lim t(Y 6 n Wf oc (q)) = oo and lim r(T e fl W(f c (q)) = oo 
£->0 £->0 

Proof. For the sake of convenience, let us set P = {Pi} i=1 4 - the set of conic 

singularities of S 0 (see equation (5) in Section 1 above). With e 0 chosen sufficiently 
small, for e £ (0,eo], construct a Markov partition V e on T 2 for the map A from 
(7), satisfying the following conditions (below the map F is the semiconjugacy from 
equation ( 8 )). 

• Each p £ F~ 1 (P) is contained in the interior of an element ofV e ; 

• if E e is an element of V e containing p, then diam(T) < e; 

• If e i > €2 and if E tl £ V ei and E t2 £ V e2 both contain p, then E e2 C E ei . 
Now projecting the interior of the elements of V e containing J r_ 1 (P) into So via F 
results in an open neighborhood U t of P in So- Define for convenience 

(13) So, e d =S 0 \U e . 

Certainly with e 0 chosen sufficiently small in the beginning, for all e £ (0, eo] there 
exist points x £ S 0i e such that Ot(x), the full orbit of x under T, does not intersect 
U e (periodic points of To form a dense subset of So). Denote the set of all such points 
by T e . It is easily seen that Y e is compact and invariant under To; furthermore, Y e 
is hyperbolic, To|y € being a factor of y i a th e smooth map F (away from 

singularities). It is also clear that {Y e } forms a dynamically monotone family (i.e. 
equation ( 11 ) holds). 

Now take a point in U e . Its stable and unstable manifolds are dense in So (since 
their lifts to T 2 by F~ x are dense in T 2 ). It follows that Y e is totally disconnected. 
It is also easy to see that T e is locally maximal. 

It remains to show (12). 

Pick a periodic point q £ T eo , say of period k. Let 17 C T 2 be a small neigh¬ 
borhood of a point q in F~ 1 (q), in particular so that F(U) fl U €o = 0. Since the 
differential DF is bounded on U, F\jj is Lipschitz with a Lipschitz constant that 
does not depend on e. Thus the distortion of thickness of any subset of U under 
application of F is bounded at most by multiplication by some positive constant 
that does not depend on e. It is therefore enough to prove 

lim t(U fl WtJq) fl J r_ 1 (T e )) = oo and 

e ->0 

limr(t/nW 1 “ c ®nP- 1 (T £ )) = oo. 


( 14 ) 
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Let us concentrate on the stable manifold, Wf oc (q) (the argument for the unstable 
manifold is similar). Also, henceforth we work with the map A = A m , where m is 
a common multiple of k and 6. While this is not necessary, it ensures that q as well 
as the points of P _1 (P) are fixed under A. 

Notice that W( oc (q) fl J r ~ 1 (T e ) is a Cantor set; let 7 C Wf oc (q) be an arc which 
is the convex hull of a Cantor subset A'(e 0 ) of W* oc (q) fl J r_1 (T eo ). Then for all 
e £ (0, e 0 ], 7 is also the convex hull of the Cantor subset AT(e), and in fact for 
ei > £ 2 , A'(ei) C K (£ 2 )• Denote by the interior of the elements of P e 

containing P _1 (P), with the two preimages of P,, i = 2,3,4, lying in and 

2 ) (Pi has a unique preimage); moreover, we may assume that the seven open 
sets {P £j (ij)} are pairwise disjoint. The gaps of the Cantor set K{e) in 7 can be 
classified into seven types, for each choice of io £ {1,..., 4} and j 0 £ {1,2} (when 
io = 1 , jo = 1 ): these are connected components of (J ngN A n (E^ iotjo) )n r The 
lengths of these connected components are controlled by the size of the rectangular 
elements E e i io j 0 \, which is in turn controlled by e, and the gaps for ei are embedded 
in those for £2 if £1 > £ 2 - We get (14) from this as follows. 

Let U = {P n }„ 6 N be a presentation of gaps as in the definition of thickness 

above for the Cantor set K(eo). Take any e £ (0, eo) and let U = \ U n } be a 

1 J ne N 

presentation of gaps for K(e) such that U n C U n . Let 

15 = , min , { \ E eoAoJo) I} and 5 = max {|P e , (io Jo) |} , 

(*o,Jo) tojo) 

where in this case | • | is the width of the rectangular elements of the Markov partition 
measured along the stable direction. Given V an element of a presentation, denote 
its length by |V|. Then we have 

U n 5 5 

— — > ^ > . 

U S e 

u n 

Now let B l n and B£ denote the two intervals left after removing Ui,... ,U n from 
the convex hull of K(e 0 ) such that B l n contains one endpoint of U n and B £ contains 
the other (respectively, B l n and B£ with U in place of U). Denote the length as 
above by |-|. We have 


and 


It follows that 


B 


l.r 


> lPi’1 


Bi 


U n 


Bl 


U n 


> 


Un 


U n 


BL \Bl 


\U n \ ’ \U n 


r(K(e)) > r{K(e 0 ))-. 


□ 


We also have the following simple 

Lemma 2.2. The sequence of sets {T e } constructed above approaches So in the 
Hausdorff metric as e —> 0. 
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Proof. Since for all ei > € 2 , T ei C Y e2 , assuming that the statement is false, we 
must have an open subset of So, call it O, such that for all e, T e D O = 0. This, 
however, is impossible since the periodic points are dense in So, and for every 
periodic point p there exists e > 0 such that the orbit of p does not intersect U e 
(the e neighborhood of the singularities, as above), so that p £ T e . □ 

We are now ready to prove (1), (2), and (3) of Theorem 1.1. 

2.2. Proof of Theorem 1.1, (1), (2), and (3). In what follows, the notation, 
unless explicitly defined, coincides with that of the statement of Lemma 2.1 and 
the proof thereof. 

With e 0 from Lemma 2.1, for e £ (0, e 0 ], let A e be an open neighborhood of T e 
such that d e fl !7 e = 0. Let B e be an open neighborhood of Y e whose compact 
closure lies in A e and To(B e ) C A e . Clearly To : B e —>• A f is a diffeomorphism with 
a compact invariant locally maximal hyperbolic set T e , which contains for every 
S £ (0, eo] with S > e. Define a family of smooth maps 

(15) 7T V ,e '■ § 0 ,e 

satisfying the following properties. 

• For every e £ (0, eo], there exists V e £ (—1,0) (increasing in e and ap¬ 
proaching zero as e tends to zero) such that for all V £ (fo e , 0), 7 ry iC is a C 2 
diffeomorphism onto its image. 

• The family {TTv,e} depends smoothly onVG (fo e ,0) and is continuous in V 
at V = 0 (that is, limy^o ^v,e = Id |§ 01 ) in the C 2 topology. 

• For any e 2 ,ei £ (0,e 0 ] with e 2 > e x , for all V £ (V ei ,0), 7 t Vj£2 = 7Tv, £l |s 0 , e2 • 

Remark 2.3. The family wv,» is easy to define explicitly by considering, for example, 
projection along the gradient flow. Also, C 2 smoothness is of course not the best 
that one can have, but it is sufficient for our purposes. 

Now for any e > 0 and V £ (foe, 0), let 

fv,e(x) = 7Ty* oT V O 1 T V ,e{x), 

where it is defined. Taking fo e sufficiently close to zero to begin with ensures that 
fv,e is defined on B e with range in A e , and in fact /V. e : B e —>• A e is a C 2 diffeo¬ 
morphism. Furthermore, fv,» clepends continuously on fo in the C 2 topology and 
for any e 2 ,ei £ ( 0 , e 2 ] with e 2 > ei, and any fo £ (fo £l , 0 ), /v,e 2 |s £2 = fv,e± \b C2 (this 
follows from the definition of /v> and properties of 7 i»). Hence by considering fo 
sufficiently close to zero, we can ensure existence of compact locally maximal in¬ 
variant hyperbolic sets for fy,» of large thickness (thickness is a continuous function 
of the diffeomorphism in the C 2 -topology - see [61, Theorem 2 in Section 4.3]), and 
hence of large Hausdorff dimension. Projecting these hyperbolic sets back into §y 
via ttv,» gives the desired dynamically monotone family of hyperbolic sets whose 
Hausdorff dimension approaches two as fo approaches zero. This proves (1) and 
(3). The proof of (2) follows directly from Lemma 2.2 and the properties of ny,»- 

2.3. Proof of Theorem 1.1, (4). Before we prove the three assertions of The¬ 
orem 1.1 (4) (namely existence of homoclinic tangencies; that the tangencies are 
quadratic; and that the tangencies unfold generically), we need some preparation, 
which is carried out in Section 2.3.1. We then proceed to prove Theorem 1.1 (4) in 
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the following order. First, we hypothesize that tangencies between certain stable 
and unstable manifolds exist. In Section 2.3.2 we demonstrate that if these tan¬ 
gencies indeed exist, they must be quadratic. In Section 2.3.3 we prove that if the 
tangencies exist, then they unfold generically. Finally, in Section 2.3.4 we show 
that the tangencies indeed exist. 

In the following sections we use standard results, notation and terminology from 
the theory of (normally and partially) hyperbolic dynamical systems. Good refer¬ 
ences would be [42] and [41]. 

2.3.1. Technical Preparation. Recall that Pi = (1,1,1) is a (fixed under T) singu¬ 
larity of Sq. This singularity lies on the curve p of period-two periodic points, and 
this curve is normally hyperbolic. Let us denote by W s (p) (respectively, W u (p )) the 
stable (respectively, the unstable) manifold of p. Denote the strong-stable (respec¬ 
tively, the strong-unstable) manifold of P\ by W SS (P\) (respectively, W UU {P\ )). 

We have the following statement, which is not difficult to see and has been used 
without explicit proof in a number of papers [19,23], and proved explicitly (in a 
slightly more general context) in [54, Lemma 4.8]. 

Lemma 2.4. The stable (respectively, the unstable) manifold of p is quadratically 
tangent to So along the strong-stable (respectively, the strong-unstable) manifold of 

Pi- 

Proof. We only prove the result for the stable manifold; the analogous result for 
the unstable manifold follows easily from the time reversal symmetry of T, namely 

(16) T _ 1 (a;,y, 2 :) = (aoToa)(x,y, z) with <r(x,y,z) = (z,y,x). 

Let F be a fundamental domain along W ss (Pi) in a small neighborhood of P \, 
and let 7 be a twice differentiable curve lying in W s ( p ) and crossing F transversally. 
It is known that W s (p) intersects transversally the surfaces ,SV>o and does not 
intersect any Sy < 0 (see Proposition 4.10 in [79]). The manifold W s (p) is smoothly 
foliated by {W s (p) D Sv} v>0 (see [ 66 , Theorem B]), and since 7 is transversal to 
F, it follows that 7 is also transversal to W s (p) fl Sy for all V > 0 sufficiently 
small, and hence also to the surfaces Sy > 0 near F. A parameterization of p is 
easily computed (by solving T 2 = T) to be 

p[x) = ( x '2^i' x ) for x *b 

and at x = 1, p( 1) = P\, moreover, as can be verified by direct computation, p 
is transversal to the surfaces Sy > 0 and lies entirely in the plane {x = z}. In the 
plane {.t = z}, p can be viewed as the graph of the function x > I(p(x)), where 
I is the Fricke-Vogt invariant from (2). A straightforward computation shows that 
I'(p(: r))|x=i = 0 and I" (p(x))\ x =\ > 0. Now 7 can be parameterized similarly by 
projecting 7 along the smooth foliation {W s (p) fl £V} r>0 onto an arc of p, and the 
claim follows. □ 

Define a diffeomorphism $ from a neighborhood U of P\ in M 3 into R 3 that rec¬ 
tifies the stable and unstable manifolds of p and in addition possesses the following 
properties. 

. $( 1 , 1 , 1 ) = ( 0 , 0 , 0 ). 

• $(VF s (p) fl U) is part of the icy-plane. 
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• <&(W u (p) n U) is part of the xz-plane. 

• 4>(VE ss (Pi)), where W SS (P\) = W s (p) flSo, is part of the non-negative y 
axis. 

. ^(^““(Pi)), where W UU (P 1 ) = W u {p) nS 0 , is part of the non-negative 2 
axis. 

• Implied by these properties, < f>(p) is part of the x axis. 

• >I> maps the surfaces U f~l Sy with V < 0 into the region of R 3 defined by 
{{x,y,z) G R 3 : y > 0,z > 0}. 

We assume that e in the proof of Lemma 2.1 is chosen so small, that the compact 
closure of the component of the neighborhood U e C So of singularities that contains 
Pi lies inside of U. From now on we redefine U e to denote the component of the e 
neighborhood of singularities that contains Pi. 

Let 

(17) Qy(x) = $ o Ty o $~ x (x) and G(x) = d> o T o $ _1 (cc) 

for all x G $(Z7) such that T o 4> _1 (:r) G U; that is, Gy (respectively, Q) is the 
push-forward of the dynamical system (S v,Ty) (respectively, (R 3 ,P)) under the 
change of coordinates 3>, in a neighborhood of Pi. 

Observe that for a given e > 0, there exists S > 0 such that for all V G (—5,6), 
T e admits a continuation A y e to the surface Sy (and in case V < 0, only Sy 
component of Sy is relevant - recall from Section 1 that the points on the other 
four smooth components of Sy, V < 0, escape to infinity - and in this case the 
continuation A y e was constructed in the previous section). 

Remark 2.5. Let us remark that T e cannot be continued to Sy for all V G (0, —1) 
since many hyperbolic periodic points become elliptic for some values of V < 0. 
See [45] for a more detailed discussion. 

Extend 7 ry, e in the previous section to the positive values of V (sufficiently close 
to zero depending on e) and set 

§y,E = f 7Ty,eO§0,e)- 

Notice that for V sufficiently close to zero (that is, if we take 5 > 0 sufficiently small 
above, depending on e), the continuation A y jE of T e is contained in Sy i£ . Define 

(18) A e d = U Ay, e . 

ve[-i,i] 

It isn’t difficult to see that A e is a compact T-invariant partially hyperbolic subset 
of the smooth three-manifold [Jye (-5 s) §v,e- Indeed, since Ty depends smoothly 
on V, the dynamical system T restricted to Uye(-5 5) can be viewed, up to a 
smooth conjugacy, as a skew product of the identity map on the interval (—<5, (5) 
and a smooth map on §o, e , given by 

(V, x) He (V, 71-yl oTyO 7T V>e (x )) 

acting on (—5,5) x Syo- For all the technical details, see [79, Proposition 4.9]. 

In the following proposition we work in the coordinate system induced by $, 
and the neighborhood U is a neighborhood of Pi as above (so that < 1>(P) is a 
neighborhood of the origin). 
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Proposition 2.6. Fix e > 0. Let F denote the segment of the positive y (re¬ 
spectively, the positive z) axis that lies in $(17) and has the origin as one of its 
endpoints. Parameterize the images under $ of the center-unstable (respectively, 
center-stable) manifolds of A e in the neighborhood U by the point of intersection 
with F, and denote this parameter by 77 . Call the corresponding manifold Wf u 
(respectively, Wff). Then there exists S > 0 such that for all 77 G F, the manifolds 

W™n<S>{U)n U $(Sv) (respectively, W™ n $(£/) n |J $(S v )j 
ve(-$,8) ve(-S,S) 

approach the xz (respectively, the xy) plane in the C 2 topology as 77 approaches the 
origin. 


Proof. We give the proof only for the center-unstable manifolds; analogous proof 
for the center-stable manifolds follows by either repeating the present proof with 
obvious modifications, or by using the symmetry (16). Thus in what follows let F 
denote the segment of the positive y axis (which, in the coordinates induced by <b, 
is the (local) strong-stable manifold of the origin). 

Define a center-unstable cone field , K cu , in the neighborhood $([/) as follows. 
For p G $([/), denote by v = (v x , v y , v~) a vector in T p R 3 , the tangent space of R 3 
at p. Given k > 0, the center-unstable cone at p of size k is defined by 

(19) K?(p) ^ {v G T p R 3 : ||„J < «(||« x || + |M)} . 


Observe that the center-unstable cone field is invariant under the action by the 
differential of Q at the origin, 


( 20 ) 


DQ 0 



0 0> 

A 0 
0 Ay 


where A = 


y/5 + 1 
2 


In fact, DQ n (K(f (p)) C Kf"j x (DQ 0 (p)). It follows that for all p sufficiently close to 
the origin, we have 


DQ v (K™(p)) c K^(S(p)). 

In particular, we may assume that the neighborhood U is taken sufficiently small 
to begin with. 

We need the following result which can be derived from general principles; for 
completeness, we include an outline of the main ideas of the proof. 

Lemma 2.7. For all e > 0 there exists 6 > 0 such that for all V G (—6,6), 
the center-stable and the center-unstable manifolds of A e intersect the surfaces Sy 
transversally. In particular, they intersect the surface Sy transversally. 

Outline of the proof. For any V G (—6, 5), denote by Hy : A 0i£ — > A y t a homeo- 
morphism conjugating T|a 0 e to TIa^. Then from [43, Theorem 7.3] we know that 
Hy is unique and is the fixed point of a certain contraction on a certain Banach 
space of continuous maps (see the proof of Theorem 7.3 in [ 13] for the details); 
furthermore, since TIs^e is smooth, and hence Lipschitz continuous, then this con¬ 
traction is also Lipschitz in V. It follows that Hy is also Lipschitz continuous in the 
G° topology. It follows that for any fixed x G Ao j£ , the smooth curve V ^ Hy(x) 
satisfies 


\\H 0 (x)-Hy(x)\\<C\V\, 
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with a constant C > 0 that does not depend on V or on x. It follows that the 
curve V H > Hy(x) is transversal to the surfaces §y e , and since this curve is the 
intersection of the center-stable and the center-unstable manifolds that contain the 
point x, these manifolds must also be transversal to Sy,e- □ 


It follows that there exists 5 > 0 such that for all r) £ F and V £ (—6,6), 
W°“ n $(f7) intersects <b(Sy fl U) transversally. Now take a fundamental domain 
along F, and call it F. Then there exists n > 0 such that for every p £ F 

if p £ W™ n $([/) n (J $(Sy) then T P $(W“) C JT“(p). 
ve(^S,S) 

By invariance and contraction of the center-unstable cones under the action of 
DQ , it follows that for any fixed r\ £ F, the images of 

n <&(u) n |J $(Sy) 

ve(-SJ) 

under the iteration by Q approach the xz plane in the C 1 topology. Equivalently, 
as Tj tends to the origin, 

W™ n $(J7) n |J $(Sy) 

ve(-<5,<5) 

approaches the xz plane in the C 1 topology. This is slightly coarser than what 
we need. To improve this result, we consider the action of ( Q , DQ) on the tangent 
bundle of W£ u , TW^ U . Elementary computation shows that at the origin (0, 0) £ 
R 3 x R 3 , 


D(Q,DQ)( 0,0) 



Thus near (0,0), we can apply to (Q,DQ) a cone condition analogous to the one 
for Q to conclude that TW^ U approaches the tangent bundle of the xz plane as 
r] approaches the origin; in other words, IE” 1 approaches the xz plane in the C 2 
topology. □ 


Lemma 2.8. Suppose G = ( G x ,G y ,G z ) : R 3 —> R 3 is a C 2 diffeomorphism. Let 
M > 0, C > 1. Then there exists £o £ (0, A — 1), with A as in (20), such that for 
all f £ (0, £ 0 ) the following holds. 

Suppose that G satisfies the following conditions. 

(i) \\\7dpG a \\ < M for a,/3 £ {x,y,z}. 

(ii) G is £-close to DQo from (20) in the C 1 topology. 

Assume also that 7 = ( n txiTyiTz) a C 2 curve in R 3 that satisfies the following 
conditions. 

(1) IIt'MII < C for all t; 

(2) 7 x(t) = t; 

(3) \lz(t)\ > 3 MG 2 for all t; 

(4) \Tz(t)\ > £ hy(t)\ for all t. 
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Then we have 
( 21 ) 
and 
( 22 ) 


i G '° 7W 


> Wzit )I + -—I-- \l"(t)\ for all t 


A-C-l 


dt 2 


G z o 7 (t) 




df 2 


G y o 7 (t) 


(A-l) 2 


hz(t)\ for all t. 


Proof. With the hypothesis (2) in mind, a direct computation gives 

(23) ^ G z o 7 ft) =Vd x G z ■ i + 7 ;V d y G z ■ 7 ' 

+ 7 "a y G z + y z Vd z G z ■ i + 7 z d z G z . 

An application of the triangle and the Cauchy-Schwartz inequalities together with 
our hypothesis (i) and (1) gives 

| vd x c z ■ y + iyVdyG, ■ y + 7 yd z G z • y | < 3 mc 2 . 

On the other hand, since by hypothesis (2) G is £ close to DQ 0 in the G 1 topology, 
we have 

\lyd y G z \ < f 17"| and Wfd z G z \ < (A - £) |t"I • 

Thus from (23) together with (3) and (4) we get 
d 2 


(24) 


dt 2 


G z o 7 (t) 


>l7"l + (A-^l)| 7 "|-3MG 2 -e| 7 ; / 


and (21) follows. 
Now observe that 
d 2 
dt 2 


772 Gy 0 7(i) =Vd x G y ■ 7' + i v ^d y G y ■ 7' 


+7"^G y + 7'V 9 z G y • y + 7 "^G y , 

which by the hypotheses (i), (ii), (1), and (2) gives 


(25) 


^G y ° 7 (t) 


<3MG 2 + ( | 7 "|+s e l7"l- 


From the inequalities (24) and (25) in conjunction with the hypotheses (3) and (4), 
we get 


A — £ — 1 




-i 


> 


> 


A — £ — 1 , (A-£-l) 2 


^G v o 7 (t) 


iy'|_3{MC 2 -{ T + { K'|-{ 2 |7 


A 

A-C-l , (A-£-l) 2 £(A-£-l) A-e-1/1 


4 8 4 4 

Now observe that the right most side of the inequality above tends to 

(A-l) 2 


x + £)-ni7: 


‘“l _1 


\< 
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as £ tends to zero. So for all £ > 0 sufficiently small, 


A-£-l 


and (22) follows. 




-( 






□ 


Lemma 2.9. Let M > 0, Cq > 0, and A 0 = \. There exist £o = £o(Co, A 0 ) > 0 
not larger than £o from. Lemma 2.8 such that for all £ £ (0, £q) and A £ (0, A 0 ) we 
have the following. 

Suppose that G is as in Lemma 2.8. Assume that 7 is also as in Lemma 2.8, with 
C = 1 + Co + Ao and the additional assumption that |7y(t)| < Co and (71(f) | < A 
for all t. Assume that for some m £ N and all n £ {1,..., to} the following hold. 

• G n o 7 can he reparameterized as 7^ ( s ) = (s,jy n) (s),ji n) (s)) (that is, 


I dt 


G" ° 7I >0}, with 7W = 7. 


iA n \s) 


< Cq and 




< A for all s. 


-£ 2 ')z n, (§) > £ 2 £ n X) (t) for all n £ to- 1} and t, s 


Then we have 

such that 7(C(s) = £ n ~ 1 \t). 

Remark 2.10. Each time that we take the image of £ n ~ 1 l under G , we reparam¬ 
eterize Go£ n ~ 1 ' ) (t) to obtain 7(”)(s) (i.e. the curve whose image coincides with 
that of Go7( n_1 ) ] but ££™\ s ) = 1)- In this context, s is always the parameter 
of 7C) (with the above property), and t is the parameter of £ n ~ 1 \ also with the 
property that = 1. 

Proof of Lemma 2.9. From the hypothesis we have for all n £ {1,..., to}, 


—£ n )(s) 

ds ly 


< Cn and 


ds lz { ) 


< A 


for all s. Hence for all n £ {l,...,m}, 7*-™) satisfies the first two conditions of 
Lemma 2.8: 

• Ils37 (n) (s)|| < C for all 5; 

(n) t \ 

• 7 x (s) = s. 

Claim 2.11. If for n £ {1,...,to}, satisfies the last two conditions of 

Lemma 2.8, then £ n ' > also satisfies those conditions; that is, 


( 1 ) 


A-g-l 


i n) (s) >3 MC 2 for alls; 


A-g-i 

4 


( 2 ) 

and, moreover. 


d 2 (n) / >. d 2 ( n )/~\ 

hr* ( s ) >£ hr y \s) 


for all s; 


(3) 

—£ n) (s) 

ds 2 ' z (S) 

> 

dt 2 lz 


3o 7 ("- 1 )(t). 



Observe that (3) implies (1). Let us first establish (3), and then prove (2). 


Proof of Claim 2.22 (3). Since £ n H satisfies the last two conditions of Lemma 
2.8, and as we have seen, for every k £ {!,...,to}, 7^) satisfies the first two 
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conditions of Lemma 2.8, 7 ^” 1 - ) satisfies the hypothesis of Lemma 2.8. Application 
of the lemma then gives 


d?_ 

dt 2 


G z o 7 (rt_1) (£) 


> 


dt 2 




A-£-l 


dt 2 




and 


A-C-l 








(A-l ) 2 




for all f. We now deduce the conclusion of Claim 2.11 (3) from these two inequalities. 
Observe that 

7 ^ n) (s) = G z o 7 (n_ 1 ) (f) with t= (G a ,o 7 <"^ 1) j (s). 

So we have 

d \li n \s) = 


ds 2 


(s G >° ^"’©)" ° l G * 0 V”- 1 '© 


(26) 


-3 


- ( -G x o^~i\t) ) -G, o 7 (- 1 )(t)—G x o 7 ("- 1 )(f). 


dt 


dt 2 


Keeping in mind that 7 !” ^ (t) = t, let us estimate from above the second derivative 
of G x o 'y( n ~ 1 ') at t. We have 


^^o 7 (B - 1) (f) 


- 3 MC 2 = 


va x G x ( 7 ( "- 1) 0)-^7 ( "- 1) 0 + 

j^-^^dyG^-^it)) • | 7 (n - 1} 0 

+ ^^"- 1) 0^G a; (7 ( "- 1) 0) 

+ ^7i n “ 1) (*)Va,G st ( 7 (n - 1) (t)) • |7 ( "- 1} 0 


+ ^7i n - 1) 0^G x ( 7 (n - 1) 0) 


- 3MC 2 , 

and the right side is strictly smaller than 


—7 (n - l) (t) 
dt 2ly 1 ' 




dt 27z W 


< 


A — £ — 1 


dt 27 * w 






So we have 


(27) 


^ G - 07(B - 1) ® 


< 


A — ^ — 1 


r ! 2 

df 2 ^ W 




df 2% W 


+ 3MC 2 . 
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This estimate then gives the following estimate on the second derivative of 7 ^ 
from below. 


^7i n) (S) > |G x o 7 ( "- 1) (t) % 

- 3A MC 2 

- A ~ ^ ~ 1 A —'Y (n_1) ('fl 

4 di* 7 * W 


72 

—A£ — 7 ("- 


1} (i) ) 


which is strictly larger than 






a - c -1 u 2 


- 3A MC 2 

_ >-H » Ay- 

4 <« j7 ’ 


-Af 


S C '° 7( ”' 


This quantity is larger than ^7i n_1) C£) if and only if 


x (|l G ' 07( ”" l ®| + ^ 1 |l G “° 7l "" > ® 

-^A-^A-aA 
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Now notice that 


1 + £(1 + A 0 + Cq) > 


dt 


G x °7 


(n-l) 


(t) 


dxGx^-'Xi)) 


(30) 


> 1 - £(1 + A 0 + C 0 ). 

Since A < Ao, this combined with (30) ensures that the previous inequality holds 
provided that 


—3 ( 1 + 
11 ° 


A-e-i 


1 / Aq(A-C-I) 


+ AoC > 1, 


with 


— 1 ~ £(1 + Ao + Cq) 


and 


v — 1 + £(1 + Ao + Co). 

This inequality holds provided that £0 is chosen sufficiently small to begin with 

□ 


(recall that Ao = \ is fixed). 

Now we proceed to show (2) of Claim 2.22: A ~|^ 1 
for all s. 


£4 n, (>) > ( 


Proof of Claim 2.22 (2). The expression for the second derivative of 7 y is similar 
to that from (26), with 7^ in place of 7 z . So the desired inequality holds if 

A-^-l 


> 0 . 


Ag.o 7 ("-‘>(t) ±G,o 

A G „ oy-’ffldc, o 7 (->(f) - Ig, 


This inequality holds if 


A-g-1 

4 

A — ^ — 1 


-e 


>0. 


^O^iii-GxO^ 

ft°z 07 ( "- 1 ) <^ 07 ( »- 1) 

^ 9 o7M ) (^ Gi o 7 ( »- 1) 

^°7 ( "- 1) ©^ s o7 ( »- 1) 


(*) 

(*) 

it) 

it) 
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From equations (30) and (27), together with the conditions that are satisfied by 


4j?G z o 7 («- 1 )(t) and « Gy 


, and the fact that A 0 = 4, it follows 


that the above inequality holds if the following holds: 


(A-l) 2 


-u — 


A-g-1 

16 


■£ 0 > 


A-?-l 






> 0 , 


with u = 1 — £(1 + Ao + Co) as above, which certainly holds for all £ sufficiently 
small (which can be ensured by taking £o small to begin with). □ 


The conclusion of Lemma 2.9 follows by induction on n, repeatedly applying 
Claim 2.11 starting with 7^. □ 


2.3.2. Order of tangencies. In this section we prove that the tangencies whose ex¬ 
istence will be proved in Section 2.3.4 are quadratic. In what follows, U and U t are 
as above (see in particular the paragraph preceding equation (17)). 

Let us fix e > 0, so small that U e lies entirely inside U. Let F s and F u , respec¬ 
tively, denote open intervals along the positive y and the positive z axes that lie 
entirely inside $([/) \ <I>({7 e ). For S > 0 small, denote by Bg and Bg, respectively, 
the strips (—5, 6) x F s and (—<5, <5) x F u in the xy and xz planes. Assuming that 6 
is sufficiently small, the orthogonal projection from the part of <f>(§o je ) into the xz 
plane that projects onto Bg is a C°° diffeomorphism. We may assume that F s (re¬ 
spectively, F u ) contains a fundamental domain for Q (otherwise we can take smaller 
e), so that it contains intersections with the unstable (respectively, stable) mnifolds 
on Sq e . Now, assuming that S > 0 is sufficiently small, the image of the orthogo¬ 
nal projection into Bg of the stable manifolds of $(Ao j£ ) that intersect F u can be 
viewed as graphs of functions s : x —> z (since they intersect F u transversally). Let 
us parameterize the family of these functions (or, equivalently, their graphs) by the 
point of intersection of the graph with the z axis, call this parameter y, and denote 
the corresponding function by s v . Clearly there exists A > 0 such that for each y, 
|s'| + |s"| < A (these functions—or, equivalently, the graphs—depend continuously 
on y in the C 2 topology). By (7 2 -continuous dependence of stable manifolds of Ay,e 
on the parameter V, it follows that the same holds when A 0 e and § 0e above are 
replaced by Ay iC and §y, e , for all V sufficiently close to zero. 

Now take an arc v of an unstable manifold of A y >e such that the orthogonal 
projection of $(u) into the xy plane falls entirely inside Bg. Suppose there exists 
m £ N and y such that Q m o <h(u) is tangent to the stable manifold corresponding 
to 77, at a point which projects orthogonally into Bg. Then the projection of 
Q m o <F(u) into Bg can be viewed as the graph of a function u : x —> z, near the 
point of tangency with s v . Obviously if |u"| at the point of tangency is not smaller 
than A, then the tangency must be quadratic. In what follows, we prove that, 
assuming V is initially chosen sufficiently close to zero and S > 0 sufficiently small, 
we do in fact have |u"| > A. 

In what follows, we assume that 

A<i and |s(J + |s"| < A; 
this assumption is justified by Proposition 2.6. 
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Write G = (Gx,Gy,Gz)- Set 

(31) M= sup ||Vd/ 3 < 7 a (p)|| and £ = \\Q\u - DGo\\ c i . 

a,(3€{x,y,z} 

pe$(U) 


Take Co = 1, A 0 = \ and take U initially so small, that £ < £o, with £ 0 = Co (Co, \) 
as in Lemma 2.9. Now to finish the proof, it is enough to prove that there exists 

def 

no £ N, no < to, such that 7 = Q n ° o $(t>) satisfies the hypothesis of Lemma 
2.9, with M, A 0 and Co as above, and, in addition, |'y"(t)| > A for all t. We can 
assume, of course, that for every n £ { 1 ,..., to}, G n o <f>(u) lies entirely in <!>([/) 
(by taking v shorter as necessary). 

Take no to be an arc of an unstable manifold of A 0i£ such that $(no) projects into 
Bg and intersects F s . Combination of Lemma 2.4 with Proposition 2.6 guarantee 
that if S > 0 is taken sufficiently small to begin with, then there exists no £ N such 
that Q n ° o $(r> 0 ) satisfies the hypothesis of Lemma 2.8 with M as in (31), G = G, 
Co as above, and, in addition, 


and 


j t G M o$(v 0 ) v (t) 

j t G {no) o^(v 0 ) z (t) 

^ w o$(4(i) 


< l, 

< A 0 , 

> A 


for all t. Hence there exists no £ N such that the same holds for every arc no of 
every unstable manifold of Ao i£ , such that the image of no under $ intersects F s 
and projects into Bf. By continuity, the same holds with Ay )£ in place of Ao j£ for 
all V sufficiently close to zero. 

Define an unstable cone field , K u in the neighborhood $([/) as follows. For 
p £ <&(£/), denote by v = (■ v x ,v y ,v z ) a vector in T p K 3 , the tangent space of R 3 at 
p. Given k > 0, the unstable cone at p of size n is defined by 


(32) K:(p) d A‘ {v G T p R 3 : |H| + |K|| < «||n z ||} . 


From (20) we see that K is invariant under DGo for any a. Then, by continuity, 
assuming U is taken sufficiently small to begin with, depending on k. we see that 
the unstable cone field is invariant under the action by DQ restricted to U. 

Take Kq £ (0,1) so that the unstable cone held of size Kq is transversal to the 
arcs of stable manifolds given above as the graphs of the functions Also, 

by Proposition 2.6, we may assume that the tangent space of the curve Q n ° o <j>(t>) 
from above lies inside the center-unstable cone held from (19) of size kq. Now if 
for some n £ {no,... , to — 1 }, | j^G™ 0 4>(i>)(t)| = 0 , then j^Gx 0 4>(u) falls into 
an unstable cone of size kq, which, by the invariance of the unstable cone held, 
cannot happen if t is such that G m 0 is close to the point of tangency. 

Hence if we set 7 ^ = G n ° o 4>(u), then for each n £ {no, ■ • •, to — 1}, G n ° 3>(f) 
can be reparameterized as 'y^ n ~ n o) as in the statement of Lemma 2.9. Indeed, 


since 


SiAn-no) 

dt' x 


it) 


= 1 , if 


d An-no) 
dt'V 


(t) > 1 , then rf- 7 («-"<>)(*) W ould fall out of 


the center-stable cone of size k 0 , since k 0 < 1- Similarly, if 


d An-no] 
dt' z 


(*) 


> Aq, 


then "°- ) (t) would lie in 0 ( 7 ^” n °H^))) which is transversal to the stable 
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manifolds in question (so, by invariance of the cones 7\“, Q m o $(y) couldn’t be 
tangent to one of the stable manifolds in question). We can now apply Lemma 2.9. 

2.3.3. Generic unfolding of tangencies. We now prove that the tangencies from the 
previous section unfold generically in the parameter V. 

Let us consider the center-stable and the center-unstable manifolds that con¬ 
tain the arcs of the stable and the unstable manifolds that were considered in the 
previous section. We can parameterize these families by the same parameter ry - 
the point of intersection with the interval F s or F u , respectively. Denote them, 
respectively, by Wff and Wf u . 

For every N £ N, there exists Vm < 0 such that if we take V in the previous 
section not smaller than Vm, then the arcs of the unstable manifolds have to be 
iterated at least N times under Q before a tangency with a stable manifold occurs 
in $(17) \ $(I7 e ) (as in the previous section). On the other hand, as N tends to 
infinity, the images of Wf u under Q N approach the xz plane in the C 2 topology, 
uniformly in 77 - this is due to Proposition 2.6. 

Thus, fix Vq < 0 so close to zero that if V £ (Vo, 0), then N is sufficiently large 
so that the manifolds Q N+k {Wf u ) intersect transversally with the manifolds WfV 
inside $(17), for all k £ N. Say for some £ N, there is an arc of an unstable 
manifold, say v, in Cj N+k ° (Wfff) that intersects an arc of a stable manifold in 
say c, tangentially (tangency taking place in the ambient manifold $(Sy) for some 
V). Denote by 7 the curve of transversal intersection of Wf s o and Q N+k °(Wff) 
(which of course contains the point of tangency v D c). The arc v is tangent to 7 
in g N+k °(w™) ; moreover, in order to show that the tangency wn? unfolds in the 
parameter V, it is enough to show that the tangency of v with 7 unfolds in V, with 
both v and 7 viewed as submanifolds of g N+k ° (VF™). 

Now, near the point of tangency, project the arcs {G N+k ° (W™) n $(§y)} r or¬ 
thogonally into the xz plane; when projected orthogonally into the xz plane, they 
can be viewed as graphs of functions uy : x —> z and, as we showed in Section 2.3.2, 

|Uy | > A. Projection of 7 can be viewed as the graph of g : x —> z. Then if g is 
sufficiently flat (that is, say, g"| < ^), then the tangency must unfold. Indeed, if 
it did not, then the tangencies would occur along the graph of g, and for different 
values of V, we claim that the graphs of Uy would intersect, and this would imply 
intersections of unstable manifolds, which is impossible since unstable manifolds 
are one-dimensional injectively immersed submanifolds of §y, and no two unstable 
manifolds of two points with distinct orbits can intersect. More precisely, we have 

Claim 2.12. Let J = [a,b] be a compact nondegenerate interval in M. Suppose 
that g : J — > R. is C 2 . Suppose further that A > 0 and \g"\ < A/2 uniformly on J. 
Then if u,v : J R. are C 2 functions such that u ", v" > A uniformly on J and the 
graphs of u and v are both tangent to the graph of g at the points ( a,u(a )) £ J x R 
and (ft,v{ft)) £ J x R, respectively, then the graphs of u and v intersect over the 
interval [a, (3] (assuming, without loss of generality, that a < (3). 

Proof. Let us assume without loss of generality that a < (3. Define the functions 
U d = u — g and V A = v — g. From the hypothesis, it follows that U", V" > 0, while 
U'(a) = V'(/3) = 0; hence U is monotone increasing on [a,/3], while V is monotone 
decreasing on [a,(3\. On the other hand, U(a) = V{(3) = 0. Hence the graphs of 
U and V must intersect over the interval [a,/3\, and so the graphs of u and v must 
also intersect over the interval [a,(3\. □ 
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Remark 2.13. Notice the assumption in the claim above that u",v" > A. In fact, 
we may assume \u"\ , v "| > A as long as u" and v" have the same sign. 

Now let us show how we can make sure that |g"| < A/2. Assuming that N is 
sufficiently large (which can be ensured by taking V sufficiently close to zero) and, 
for convenience, even, £ _Ar / 2 (IT™) and g N / 2 + k o (IV™) are both close in the C 2 
topology to the xy and the xz planes, respectively; hence orthogonal projection of 
their intersection onto the xz plane can be considered as the graph of a function 
g : x —> z with |g'| + |g"| < Certainly g N / 2+k °(v) projects onto the graph of 
some u : x -A z that exhibits a tangency with g. On the other hand, assuming 
that N/2 > no, with no as in Section 2.3.2, we see that (as has been proved in 
the previous section) |u"| > A, and the same holds for the arcs of the unstable 
manifolds close to v. Hence the tangency of u with g unfolds, which of course 
implies that the tangency of v with c unfolds, as desired. 

It now remains to prove that the unfolding occurs with nonzero speed in the 
parameter V. To this end, let us consider the following setup. As above, let v 
be an unstable manifold lying in IT™ for some r/i, and let c be a stable manifold 
lying in some for some 772, such that for some k £ N, g N+k °(v) intersects ? 
tangentially (on the surface $(§Vi) for some V\ £ (Vo,0) with V 0 as above). Take 
S > 0 small (in particular smaller than (Vj — Vo)/ 2) and project all the stable 
manifolds IT™ fl <I>(Sy) with V £ (Ti — S, V\ + 5) orthogonally into the xz plane. 
Each of these manifolds can be viewed, as we have done above, as the graph of 
a function Sy ■ x —> z, and these functions depend continuously on V in the C 2 
topology. Also project orthogonally all the unstable manifolds t/ w+fco (IT™)n<I>(Sy) 
into the xz plane, for V £ (Vi — <5, V\ +<5). These can be viewed, as above, as graphs 
of functions uy ■ x —> z. 

Remark 2.14. Notice that the family {sy} is different from the family {s,,} that 
was considered in the previous section. In the previous section, we fixed V and 
considered a family of stable manifolds on the surface <h(Sy), parameterized by the 
parameter 77 . Here we fix 77 and consider the continuation of the stable manifold 
IT™ fl <h(§o) along the paramter V, which is precisely IT™ fl <b(Sy). Similarily for 
the unstable manifolds. 

Since g N+k ° {v) and <r intersect tangentially, the graphs of Uy 1 and 5y 1 also in¬ 
tersect tangentially in the xz plane; moreover, since the tangency unfolds (as we 
saw above), for all V > V±, there exist ay, by on the x axis, ay < by, such that 
the graphs of u y and Sy intersect transversally at the points Uy(ay) = Sy(ay) and 
uy(&y) = 5y{by). Let M(V) denote the maximum of (sy — uy) on the interval 
[ay,by]. Notice that the function M : (Ti,Vi + <5) — R is smooth and can be 
smoothly extended to the point Vj, with M(V j) = 0. We now need to prove that 
M'iy j) 7 ! 0, which would imply that the unfolding of the tangency of G N+k °(v) 
with occurs with nonzero speed in the parameter V. We have 

Claim 2.15. There exists C > 0 such that for all V > V\ sufficiently close to V\, 
M(V) > C(y — Vj). 

Proof. If p denotes the point of tangential intersection of v and <j, let q denote the 
point G~( N+k °\p). Let uy denote the arc of the unstable manifold G N+ko (Wf/f ) fl 
<h(§y) that projects orthogonally onto the graph of Uy over the interval [ay, 6 y], 
and let uy denote g~( N+k °'> (uy). Take a smooth, compact curve passing through 
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q and the interior of each uy, V G (Vi, V\ + S ), transversal to the surfaces $(Sy), 
and such that its tangent direction at each point falls inside the cone K™ from (32), 
with k = 1. say; let us call this curve /3. This cone field is invariant under the action 
by DQ provided that we work inside a sufficiently small neighborhood of the origin 
(this restriction has already been taken into account in Section 2.3.2). The image 
of this curve under Q N+k ° gives a smooth, compact curve, say a, with the following 
properties. The curve a passes through the point p and through the interior of each 
of the arcs uy, and the tangent space of a falls inside of the cone field Let 
us now project a orthogonally into the xz plane to obtain a curve, call it a, that 
passes through the point of tangency of Sy 1 with u y 1 and a point in the interior of 
the graph of each of the functions Uy over the interval [ay, by], V G (V), Vi + 5). 
Now recall from Section 2.3.2 that \s' v \ < 1. Using this together with the fact that 
the tangent space of a also falls inside the cone field K%, we get the following. 

• If W denotes the line segment parallel to the z axis that passes through 
the graph of 5 y 1 and the point an Graph(uy |[ OV) f, v ]), an d Vv\ denotes 
the length of ly, then there exists Co > 0 independent of V such that 
\ly\ > Cq |ay |, where ay is the arc along a connecting the points Sy, H Uy 1 
and a n Graph(uy | [av>bv] ). 

On the other hand, since is close in the C 2 topology to the xy plane, there 
exists a constant C\ > 0 such that for any V, the maximum distance between the 
graphs of Sy and Sy 1 is not larger than C\{V — Vf). Hence the distance from the 
point an Graph(uy \[ av ,b v ]) is not smaller than C 0 |ay| — Ci(V — Vi). Hence, to 
finish the proof it is enough to show that |ay | > gA(V — Vi) uniformly in V. 

Let /3y denote the arc along /3 with endpoints q and uy n /3. Then there exists 
C 2 , independent of V (depending only on the size of the cone K%, but we have fixed 
k = 1), such that \/3y\ > C 2 (V — Vi). By the expanding property of the vectors 
inside of the cone field A"“, we know that there exists C 3 > 0, independent of V, 
such that for any to G N, if for n = 0,..., to, Q n (x) G H>(C/), then for any vector v in 
K%(x), 11.DC ?” 1 (u)11 > G 3 VA 1 ” ||n||, with A as in (20) (assuming that U was initially 
chosen sufficiently small). Hence we know that |ay| > C 2 C 3 V\ N+k °(V — Vi). Thus 
it remains only to make sure that C 2 C 3 V \ N+k o > Cl independently of V. This 
can be ensured by considering V\ sufficiently close to zero to begin with, since then 
N will be suitably large. □ 

2.3.4. Existence of tangencies. Now we prove that the tangencies that were postu¬ 
lated in Section 2.3.2 indeed occur. That is, we prove that for all V <0 sufficiently 
close to zero there exist points q\ and q 2 in A y e such that the unstable manifold of 
qi intersects the stable manifold of q 2 tangentially, and the tangency is quadratic 
and unfolds as in Section 2.3.3. From this statement, together with the fact that 
there exist periodic points whose global stable (respectively, global unstable) man¬ 
ifolds form a dense sublamination of the stable (respectively, unstable) lamination, 
it follows that there exists a periodic point p in Ay i£ , such that the stable and the 
unstable manifolds of p exhibit a quadratic tangency that unfolds as in Section 
2.3.3. 

We continue working with Ay |£ and A e from the previous sections. Our argu¬ 
ments in principle follow the technique that was introduced by S. Newhouse in [58]; 
that is, we compare two Cantor sets of large thickness (greater than one), where 
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one Cantor set does not fall entirely into a gap of the other, and conclude that these 
Cantor sets must have nonempty intersection. The points of this intersection will 
be the sought tangencies. These Cantor sets are obtained as transversal intersection 
of a smooth curve with the stable and the unstable manifolds of Av.e on the surface 
§y. This smooth curve is a curve of tangencies of two foliations, one containing the 
stable, and the other the unstable, manifolds as a sublamination. Thus, the whole 
proof consists of the following steps. 

(1) Construct stable and unstable C 1 foliations with C 2 leaves and C 1 tangent field, 
such that stable and unstable manifolds, respectively, form sublaminations of 
those foliations. 

(2) Demonstrate that the leaves of the stable foliation contain quadratic tangencies 
with the leaves of the unstable foliation, and in fact these tangencies form a C 1 
curve. Moreover, this curve is transversal to both foliations. 

(3) Show that the intersections of the curve of tangencies constructed in Step (2) 
with the stable and the unstable manifolds form Cantor sets of large (greater 
than one) thickness, and one of these Cantor sets does not fall entirely into a 
gap of the other. 

(4) Conclude that the two Cantor sets must have nonempty intersection. There¬ 
fore, there must exist stable manifolds that intersect tangentially with unstable 
manifolds (and, combined with the results of Sections 2.3.2 and 2.3.3, these 
tangencies are quadratic and unfold generically in the parameter V). 

(5) Conclude that there exists a periodic point the stable and the unstable man¬ 
ifolds of which intersect in a quadratic tangency; moreover, these tangencies 
unfold as in Section 2.3.3. These will be the sought homoclinic tangencies. 

Before we begin with Step (1), let us note that the notation from the previous 
sections is carried over to the present section, unless explicitly redefined. 


Step (1). Denote by F 3 (respectively, F u ) a fundamental domain for Q 3 along the 
interval F u (respectively, F 3 ) (recall that F s is an interval along the positive y axis 
that lies in '!>([/) but not in $([/ e ), and F u is an interval along the positive z axis, 
with the same properties; by taking e smaller as necessary, we may of course assume 
that F s ’ u contains a fundamental domain for Q 3 ). As before, by 77 we denote the 
parameter along F 3 (respectively, F u ) which indicates the point of intersection with 
an unstable (respectively, stable) manifold. Let r / 3 and rjf (respectively, 77 “ and 77 “) 
denote the two endpoints of F 3 (respectively, F u ). Following previously introduced 
notation, denote by W° s (respectively, W ™) the center-stable (respectively, center- 
unstable) manifold that crosses F u (respectively, F 3 ) at the point 77 . 

As has already been mentioned in the previous section, for all V sufficiently 
close to zero, the orthogonal projections from <F(§y ie ) onto B 3 S and Bg are diffeo- 
morphisms. Let us denote these projections by Py : Bg —► <f>(§y e ) and P y : Bg —> 
<fr(§y j6 ). For a choice of 5 s , 6 U £ (0, <5), let Bg s v (respectively, Bg u v ) denote the 
subset of P y(Bg s ) (respectively, Py(Bg u )) that is bounded between the two curves 
W%t D $(Sy e ) and bF™ n <f>(Sy £ ) (respectively, W°! n $(Sy j£ ) and n $(§ Vi£ )). 
Of course, assuming that 5 is initially chosen sufficiently small and V is sufficiently 
close to zero, we have Bg a v C U and Bg u v C U. Then Bg, v (respectively, 
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Bgu v ) is laminated by arcs of one-dimensional unstable (respectively, stable) man¬ 
ifolds that when projected back into B s g (respectively, Bg) via P^ 1 (respectively, 
Py” 1 ) intersect F u (respectively, F s ) transversally and stretch completely across 
Bg (respectively, Bg). Since T : §y —► §y, and hence also Q : 4>(Sy) —*■ $(Sy), 
is of smoothness class C >2 (in fact, C 2 suffices), this lamination can be extended 
(locally) to a C 1 foliation with C 2 leaves that when projected via P(; M into Bg’ u 
also intersect F s,u transversally and stretch completely across Bg' u . Moreover, the 
tangent vector field of this foliation is C 1 (for more details, see [ , Theorem 6.4b]). 

Of course these local foliations can be extended to complete C 1 foliations of 
Bgs v an d Bg u v with C 2 leaves and C 1 tangent vector Held that satisfies the same 
properties when projected back into Bg’ u (i.e. the leaves intersect F s,u transversally 
and stretch completely across Bg’ u ). Let us call this complete foliation of Bg. v 
(respectively, Bg u v ), Fy (respectively, Fy). The leaves of Fy (respectively, Fy) 
can be parameterized by the parameter r]y which is the point of intersection of 
the projection (via PfW 1 , or, respectively, Py _1 ) of the leaf into Bg (respectively, 
Bg) with F s (respectively, F u ). The leaves of Fy U depend continuously in the C 2 
topology on the parameter riv 

Denote by M s the fundamental domain for Q in F s such that F s = Q~~ l (M a ) U 
M s U Q(M S ). If r]i and ??2 are the two endpoints of M, denote by Mg. v the subset 
of B s g s y that is bounded by Wfjf, i = 1,2. We define M u and Mg u v similarly, 
with F u , F u , Q- 1 , Bg,,y and W cs in place of F s , F s and Q, B s g. v and W cu , 
respectively. □ 

Step (2). We now prove that the leaves of the image of the foliation Fy under 
Q k for sufficiently large k (depending on V) exhibit quadratic tangencies with the 
leaves of Fy. 

Proposition 2.16. For all S u £ (0,(5) there exists 6 s £ (0, <5) and Vo < 0 such 
that for all V £ (Vo,0) the following holds. For every leaf v of Fy in Bg s v there 
exists k(V,v) £ N, such that G k {v) exhibits a quadratic tangency with a leaf of Fy 
in Bg u y. 

Proof. With e denoting the radius of the neighborhood U e as above, let Vo < 0 
so close to zero that for all V £ (Vo,0), the center-stable and the center-unstable 
manifolds of A e intersect the surfaces Sy transversally in the neighborhood U as in 
Proposition 2 . 6 . Denote <h(t/ D Ure(v 0 o) §v) by 1. Let us define two partitions of 
1 , V s and V u , consisting of stable and unstable fundamental domains respectively, 
as follows. 

Fix a center-stable (respectively, a center-unstable) manifold, and call it, say, 
W cs (respectively, W cu ) and define, for n £ Z, the sets J* (respectively, J“) as 
the set of those points in 1 that lie between (or on) the two manifolds G n (W cs ) fll 
and gV-V(W cs ) n 1 (respectively, g n (W cu ) H 1 and g( n ~P(W cu ) n 1). Now let 
V s = {J a : n £ Z} and V u = {J“ : n £ Z}. Of course, V s and V u are not partitions 
in the strict sense, since for any n £ Z, the sets and J“ intersect the sets J ® ±1 
and J" ±1 , respectively, along the boundaries (formed by two center-stable and, 
respectively, center-unstable manifolds). Also notice that there exist N S ,N U £ N 
such that for all n s > N s and n u > N u , = 0 (we assume that N s 
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and N u are the smallest such numbers). Essentially, we’ve sliced 1 into stable and 
unstable fundamental domains. 

Lemma 2.17. For any choice of 5 U £ (0,5), there exists 5 s £ (0,5) and Vg < 0 
not smaller than the Vg above such that for all V £ (Vo, 0) and every arc v in Fy 
that lies in Bg s v n J ®, for some n £ Z, there exists a k = k(V, v) £ N such that 
Q k {y) lies in Bg uv . 

Proof. Observe that there exists m £ Z such that Mf„ v lies entirely in J^, by 
construction, and Bg u v = v )UMg u v UQ(Mg u v ). If we take 5 s sufficiently 

small, we know that there exists Vo < 0 such that for all V £ (Vo,0), every point 
of <V(Sy) that lies in Bg s v has its z coordinate strictly smaller than that of every 
point lying in Bg uy . It follows that there exists k £ N such that J® +fc = in 
particular, Q k (v ) lies in So in order to prove that Q k (v) lies in Bg u v , it remains 
to prove that the orthogonal projection of G k (v) into the xz plane lies in Bg u . We 
prove this next (in the proof we shall require that k is large enough, which will be 
guaranteed for all V sufficiently close to zero). 

Recall that the surface $(§o) exhibits a quadratic tangency with the xz plane 
along the z axis; recall also that the surfaces $(§y) depend continuously on V in 
the C 2 topology away from a neighborhood of the singularities. It follows that for 
any given 5“, there exists eo > 0 and Vq < 0 such that for any V £ (Vo,0), any 
point that lies on $(Sy) and whose distance from the xz plane is not larger than 
eo orthogonally projects into the strip (—5“,5“) x z in the xz plane. It therefore 
suffices to prove that every point of G k (v) is not further than eo away from the xz 
plane. 

Observe that there exists d > 0 such that for all V £ (Vo,0) and all points p 
in BL V , the distance from p to the xz plane is not larger than d. On the other 
hand, there exists IV £ N such that any point p £ <&(£/) whose distance from the xz 
plane is not larger than d and such that for every n £ {1,..., IV}, G n (p) £ $(17), 
the distance from Q N (p) to the xz plane is smaller than eo- Thus we need to make 
sure that k is larger than IV; this can be done by choosing 5 s sufficiently small as 
well as Vo sufficiently close to zero (that is, we need to make sure that the distance 
from any point p in Bf a v to the xy plane is sufficiently small). □ 

Let Vo < 0 be not smaller than the Vo from Lemma 2.17 and, in addition, the 
following holds. The tangent space of every leaf from Fy when projected into the 
strip (—5,5) x z in the xz plane makes the angle with the horizontal not larger 
than 7 t/8 radians (this can be ensured by an application of Proposition 2.6). Let d 
denote the minimal distance between the two center-stable manifolds (restricted to 
the neighborhood $([/)) that mark the boundary of J^, with M'f„ v contained in 
J^j. Let us assume that 5 was initially chosen so small, that for every S u £ (0,5), 
the following holds. 

(Cl) If 7 is any smooth curve in the strip (—5“,5“) x z that connects two points 
at least at distance d from each other, then at some point p £ j, the tangent 
space Tp'y makes the angle of at least tt /4 radians with the vertical. 

Now with the notation as in Lemma 2.17, let v be a leaf of Fy that lies entirely 
in J®. Observe that since the center-unstable manifolds can be assumed to be 
arbitrarily close in the C 2 topology to the xz plane (again applying Proposition 
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2.6), and since $(So) exhibits a quadratic tangency with the xy plane and away 
from the singularities the surfaces $(Sy) depend continuously in the C 2 topology on 
V, there exists a smooth curve v, namely a connected subset of the stable manifold 
that contains the arc v, with the following properties. 

(C2) v is connected, does not intersect itself, and contains v; 

(C3) v is contained in J* U J^ +1 

(C4) v fl J* +1 consists of two connected smooth disjoint branches, say v\ and v 2 , 
with (~l i *2 = 0, and fq, i = 1,2, connect the two center-stable manifolds that 
form the boundary of JF 1 . 

(C5) There exists a cone field K u (p), p £ <!>([/), with K u (p) transversal to the 
horizontal plane, invariant under DQ, and the curves (rather, their tangent 
spaces) Vi, i = 1,2, fall into this cone field. 

(C6) The branches Vi, i = 1,2, are oppositely oriented. More precisely, if we 
parameterize v on some compact interval, then the unit tangent vectors of 
v\, by transversality with the horizontal, must have either strictly positive 
or strictly negative z component; then those of v 2 have, respectively, strictly 
negative or strictly positive z component. 

Remark 2.18. We should remark that (C5) is not completely obvious. Albeit above 
we have already constructed an invariant cone field, which we called K]f, trans¬ 
verse to the horizontal, the cone field K u (p) is different in that it does not have a 
fixed opening angle k, but its angle depends on p and approaches 7 r radians as p 
approaches the xy plane. This is needed since we want (C5) to hold independently 
of any choice of 5 s and V. Nevertheless, such a cone field can be constructed - see 
Proposition 3.12 in [19] for the details. 

Now as a direct consequence of the above, we have the following. 

As in the proof of Lemma 2.17, apply G k times such that J* +fc _ 1 = (hence 
Jn + k = Jfn- 1 , and G k (v) still falls in f3J„ v , even though it is one iteration less 
than what is stated in Lemma 2.17: we can adjust k by taking V closer to zero as 
necessary). Now from the invariance of the cones from (C5) we get that the branches 
G k (vi), i = 1,2, are transversal to the horizontal and are oppositely oriented as 
in (C6). Since these branches connect the center-stable manifolds that form the 
boundary of Jjf, we know from (Cl) that for i = 1,2, G k (vi) contains a point Pi such 
that that T p . zq makes an angle with the horizontal of at least 7r/4 radians. Since 
the two branches are oppositely oriented, and since G k (y) is connected, there exists 
a point in v which is tangent to a leaf of the stable foliation Fy, since the leaves 
of Ty when projected into (—5, 5) x z were assumed to make the angle with the 
horizontal of not larger than n/8 radians. This completes the proof of Proposition 
2.16. □ 

We can now carry out this construction for every leaf of J~y, concluding that 
every leaf of G k {Ry H M| s v ) intersects tangentially with a leaf of Ff. In Section 
2.3.2 we proved that this intersection is quadratic. We now need to prove that these 
tangencies form a C 1 curve that is transversal to the foliations G k {Fy(^M^ B v ) and 
Fy. This is done in [58, Lemma 9]. Let us record this result for later reference as 

Proposition 2.19. For every S u £ (0, <5) there exists 6 s £ (0, <5) and V 0 < 0 such 
that for all V £ (Vq, 0) the following holds. There exists k £ N such that for every 
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leaf v of Ty in Mg, v , G k {v) exhibits a quadratic tangency with a leaf of Ff in 
Bg u y. These tangencies form a C 1 curve transversal to both, the stable and the 
unstable foliations Ty and G k {J-y H Mg, v ). 

□ 


Step (3). We begin by proving a bounded distortion property for Q\ $([/), given in 
the following lemma. 


Lemma 2.20. For eachp in the neighborhood <f>(f7), (p) be the unstable cone 

at p as defined in (32), with k = 1. Define the stable cone at p, Kf(p), similarly, 
with v y and v z interchanged in (32). Then ifU is taken sufficiently small, we have 
the following. 

(1) If G{p) £ U (respectively, t? _ 1 (p) £ U), then DQ(Kf (p)) lies in the interior 
of K™(G(p)) (respectively, DQ~ 1 {K((p)) lies in the interior of Kf (Cf _ 1 (p)); 
moreover, there exists a constant A > 1 such that the vectors in K\{p) 
(respectively, K((p)) expand under the action by DQ (respectively, DQ~ X ) 
by a constant not smaller than A. 


(2) There exists C > 0 such that the following holds. If k £ N and for every 
n £ { 1 , G n (p) £ U (respectively, G~ n {p) £ U), then for any v £ 

Kf (p) (respectively, v £ Kf(p)) with ||u|| = 1, 

±i / „.... ±1 


(33) 


\DG k Jv)\ 


< C (respectively, 


DG., 


— k 


-k 



<c), 


(34) 


. DQ k 0 {v)\\) ' ‘ " Vll^o 

where DQo was defined in (20). 

(3) As a corollary of (2), there exists a constant D > 0, independent of k 
from (2), such that the following holds. If v £ K((p) and u £ K((p) with 
IMI = IMI = 1; o.nd for all n £ { 1 ,..., k}, G ±n {p) £ U, then 

±i 

< D. 



Proof. Observe that DG can be forced arbitrarily close to DQo in the C 1 topology 
by taking U sufficiently small, so (1) follows by continuity (in fact, this shows that 
A can be taken arbitrarily close to A). 

Let us prove ( 2 ). We shall prove the claim in (33) for DG ; the claim for DG~ X 
can be proved similarly. 

Observe that 

/ ||Dg p fc (u )|| \ ±1 / ||£>g P 0 M||||£>g P 1 MI|-- ■||gg Pfc _ 1 K - 1 )|| \ ±1 
ijlWoMII; V \\ D Go(uo)\\\\DGo(.u 1 )\\---\\DGo(u k -i)\\ ) ’ 

where 

, r ^ i DGp„_ i(Ura—l) DGo{u n —\) 

v 0 = u 0 = v , and for n> 1 , v n = y-— ---and u n = -ttt, 

(«n-l) || \\DGo{Un-l)\\ 


and 


Po=P, and for n > 1, p n = G{Pn- 1 ). 
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Now we have 

k -1 

< \ l °S\\ D Gpn( V n)\\ -log||WoK)||| 
n—0 

fc-1 

< LY\\\ D GpA v n)\\ - H-WoKOIII , 

n— 0 

where L > 0 is a Lipschitz constant for the function log |[i,oo)- O n the other hand, 
k -1 

lY III^K)II-II^oK)||| 

n=0 

fc-1 

< ^E ||-D^p„(Wn) - Wo(«7l)|| 
n—0 
fc-1 

= ^E ||£>^p n (v n ) - DQ 0 [u n ) + DQ Pn {u n ) - DQ Vn {u n )\\ 

n— 0 

\ fc—1 fc—1 

sup \\DG Pn \\ ) lY \\ v n - u n \\ +lY II D G P „ - Wo|| ■ 

0 <n<k-l J n=Q n=0 

Since the supremum above is uniformly bounded (in k ) because p n £ U for all n 
and Q is C 2 , it is enough to bound uniformly in k the two sums 

k -l k -1 

(35) E 11 ^ri ^n|| and ^ ) ||W Pn Wo 11 • 

n— 0 n=0 

To keep our arguments better organized and easier to read, before we continue, 
let us state and prove as a separate claim the following simple result. 

Lemma 2.21. There exists p £ (0,1) , Vo < 0, and C 0 > 1, such that for all k £ N 
and V € (Vo,0], the following holds. Suppose that po £ $(/7 flSy) and for all 
n £ {1,..., k}, G n (po) G Let p n = G{p n - 1 ). Let d n denote the distance from 

p n to the origin. Then there exists no £ {1,..., k} such that for all n* £ {1,..., ?ro} 
and n* £ {?ro + 1,..., k} we have 

(36) d n , < C 0 p n *d 0 and d n , < C 0 p k ~ n *d k . 

Proof. Denote by d„ }S = d njS (p) and d niU = d niU (p) the distance from p n to the xy- 
and the xz-plane, respectively. Let d n = + <T^ U denote the distance from 

p n to the x axis. Let n o be the maximum in {l,...,fc} such that for all n* £ 
{1,..., no}, d n ,, u > d n . tS . Then for all n* £ {1,..., no} and n* £ {no + 1,..., k} 
we have the following. 

d n , < V 2 d n „u and d„* < V 2 d n *, s . 

On the other hand, there exists p £ (0,1) and a constant C\ > 1 such that for any 
k £N and p £ $(17), if for all n £ {1,..., k}, G n (p) S $([/), then 

dn,u — p do^ and d n ,s — V7|/./ d ks ^ 



/||Wp fc M||A^ 
\\\DGo(v)\\ ) 
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which follows easily from C 1 closeness of DQ to DQq. Thus, for all n» in {1,..., no} 
and n* £ {n 0 + 1 ,..., k}, we have 

d n „ < V 2 Cm n *do, u < \/ 2 CiAt”*d 0 and d n . < < y/ 2 C x p k ~ n ‘d k . 

Since <E>({7 nSo) has a conic singularity at the origin, there exists C 2 > 0 such that 
for all V £ (Vo, 0 ] with Vo < 0 sufficiently close to zero, and for all p £ $([/ D Sy), 
we have 

dist(p, x) < dist(p, 0 ) < C 2 dist(p, x). 

where dist(p, x) and dist(p, 0 ) are the distances from p to the x axis and to the 
origin, respectively. □ 

Let us now continue with the proof of (2) of Lemma 2.20. Since Q is C 2 , in the 
notation of Lemma 2.21 we have 

fc-l k- 1 

^wrtg^-DGoW 

n—0 n—0 

with C 3 > 0 some constant independent of n and k, and the right side is bounded, 
by Lemma 2.21, independently of k. It remains to bound the first of the two sums 
from (35). 

Since v n and u n are unit vectors, it would suffice to bound 

k-1 fc-l k-1 

(37) E Z(v„, U n ) < E A v n, z) + 

n—0 n—0 n=0 

where z denotes the direction parallel to the z axis. It is easy to see just from the 
definition of DQq that there exists jl £ (0,1) such that 

(38) for any v £ and b£N, Z(DQq (v), z) < jl n /.(v, z). 

Hence the second sum on the right in (37) is bounded uniformly in k. Let us now 
demonstrate that the first term in the sum on the right in (37) is also bounded 
uniformly in k. 

We have 

k— 1 no k— 1 

(39) E Z(u n ,z) = E ^(w„,,z) + E 

n=0 n* =0 n*=no + l 

with no as in Lemma 2.21. From the definition of DQ 0 , we see that x, y and 
z, where x, y, and z are the directions parallel to the x, the y, and the z axes, 
respectively, are eigendirections of DQq , and vectors in the z direction expand by 
A > 1, while vectors in the x direction neither expand nor contract, and vectors 
in the y direction contract by 1/A < 1. By continuity, for any 5 £ (0, y^y), U 
can be taken sufficiently small such that for all p £ &{U) there exist constants 
Pp > 1 > /ip > 0 and /i/ > 0 , and a constant C 4 > 0 independent of p , such that 
the following statements hold. 

• p,p £ (A — 5, A + S), Up £ (1/A — <5,1/A + 5), and £ (1 — <5,1 + 5) are 
eigenvalues of DQ p . 

• Denote the eigenspaces of DQ p corresponding to the eigenvalues p* by E*, 
* £ {s, it, c}. Then the tangent space 0 /R 3 at the point p is 

T p R 3 =E^®E c p ® E s p , 
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and 

A E p,y), A e ;,z), 1{e c p1 a<5. 

Consequently, there exists ft £ (0,1) such that for every p £ U and v £ 
K™(p), we have 

i(Dg p {v),E;) < pAv,e;). 

• For any p,q £ &(U), we have 

|Mp-Mg| < C 4 \p-q\ 

and 

A E p, z) < C 4 dist(p, 0), 

A E p, y) < C 4 dist(p,0), 

Z(£p, x) < C 4 dist(p, 0). 

Now for n* £ {0,..., no}, we can estimate A v n» > z ) as follows. Observe that 

(40) Avn, , z) < AVu, , EA ) + A E p„, , z) < ^(«n. , E p n , ) + . 

On the other hand, we have 
Claim 2.22. For n* £ {0,..., no}, 

71 * 

(41) Avn„ E pJ < » n 'Avo, E % 0 ) + 2C 4 C 0 Y / p n -~ j p j d 0 , 

1=1 

with p and Cq as in the statement of Lemma 2.21, and do as in die proof thereof. 

Remark 2.23. We adopt the convention that for i < j, • = 0. 

Proof of Claim 2.22. The result obviously holds with n* = 0. For the case n* > 0 
we proceed by induction. In what follows, d n , n = 0,1,..., is as in the proof of 
Lemma 2.21. For n* = 1, we indeed have 

Avi , E U P1 ) < Am> E P 0 ) + A E P 0 , K ,) 

< ftAvo,Ep 0 ) + A E P 0 . ^) 

< £Z(u 0 , ) + Z(£“, z) + Z(£“ , z) 

< pAv 0, E p 0 ) + Or do + C 4 d 4 

< pA v o ! E p 0 ) + C 4 Codo + C 4 CqpA, 

where the last inequality follows from (36). 

Assuming now that the claim holds for some n* £ {1,..., no — 1}, for n» + 1 we 
have the estimate 

AVn,+l, E A +1 ) < P-AVn, , E A ) + A E p n , , ^p n . + 1 ) 

< A U"*/(ii 0 ,^J + 2C 4 Co^A"* _ Vrfoj + 2C 4 C' 0 // l * +1 d~ 0 , 


which gives (41). 


□ 


NEWHOUSE PHENOMENA IN THE FIBONACCI TRACE MAP 


35 


Now combining (40) with (41), we obtain 





Y, Z K„> Z ) < E ^‘Avo,e; o ) + 2 C a c 0 J2 Y ^~ j ^do + c 4 Y d n „ 



which is bounded (uniformly in no). Similarly one can show that the second sum 
on the right of (39) is uniformly bounded in k and no- 

To prove (3), keeping in mind (2), it suffices of course to prove that there exists a 
constant C 5 > 0 such that for any unit vector v £ Kf and any unit vector u £ I\(, 
and any n £ N, 



but this follows immediately from the definition of DQq. 


□ 


Lemma 2.24. For any 8 > 0, there exists a sufficiently small neighborhood U of 
Pi such that the change of coordinates $ : U —> R 3 can be chosen in such a way 
that in addition to the properties listed in Section 2.3, <f> also satisfies the following. 

There exists a nonempty open subset Af of $([/), and constants C > 0 and 
Vq < 0, such that for all V £ (Vo,0), $(§y n[/)\A/’ ^ 0, and we have the following. 

(1) The part of the plane {y = z, y > 0} n <&(£/) lies in Af. 

(2) For all p £ Af, PziPy 7 ^ 0 and < C, where, as above, p y and p z are 

the y and the z coordinates of p, respectively. 

(3) For all V £ (Vo,0) and p £ $(§ 1 / D U) \Af, the tangent plane o/<f>(§y) at 
p makes the angle of at most 8 radians with the xz plane (respectively, the 
xy plane) if p z > p y (respectively, if p z < p v ). 

Proof. Notice that Pi is a nondegenerate singularity of the Fricke-Vogt invariant 
I(x,y,z) = x 2 + y 2 + z 2 — 2 xyz — 1. By the Morse lemma, we can find a dif- 

feomorphism ik from a neighborhood of Pi into R 3 , mapping the surfaces Sy to 

the hyperboloids x 2 + y 2 — z 2 = V, and the point Pi to the origin. Denote, as 
above, the strong-stable (respectively, the strong-unstable) manifold of Pi on So 
by W ss (respectively, W uu ). Denote by (■ r,9,z ) the cylindrical coordinates on M 3 . 
The stable and the unstable foliations on So are uniformly transversal in a neigh¬ 
borhood of Pi (see Lemma 3.1 in [16]); consequently, the tangent directions of 
Kxy o \k(kF ss ) and tt xv o ^{W uu ), where n xy denotes the orthogonal projection into 
the xy plane, are uniformly transversal on the xy plane in a neighborhood of the 
origin. Thus there exists a smooth map a : [0, 27r) xl -) [0, 27r) x R, such that 
a : (r, 9, z) i-A (r, a(9 , z), z) is a diffeomorphism on R 3 and ao 4/(kF ss ) (respectively, 
a o '5>(y\7" uu )) is part of the line {(0,t, t) : t £ R} (respectively, {(0,t, —t) : t £ R}); 
clearly a preserves the hyperboloids x 2 + y 2 — z 2 = V. Finally, let 0 : R 3 —> R 3 
denote the rotation by — j radians about the x axis. Then 0 o a o \k maps the 
surfaces Sy to the hyperboloids x 2 + y 2 — z 2 = V rotated about the x axis by — | 
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radians, such that P\ is mapped to the origin, W ss is mapped onto part of the 
positive y axis, and W uu is mapped onto part of the positive z axis. 

Denote the center-stable (respectively, the center-unstable) manifold that con¬ 
tains W ss (respectively, W uu ) by W cs (respectively, W cu ). Let II denote the 
smooth two-dimensional submanifold of ]R 3 that is foliated by the curves {£„} with 
(o = 0°«° ^>(W CS n W cu n U), and for « / 0, is the translation of £o by u 
units in the direction of the vector (0,1,1). Let Q denote the push-forward of the 
Fibonacci trace map T by the diffeomorphism 0 o a o in the neighborhood U. 
Let A4 denote the region of 0 o a o ^(U) \ £o bounded by the surfaces C/ -fc (II) and 
t/ fc (II), k G N. If U is sufficiently small, (l)-(3) hold with A4 in place of A f and 
0oao$ in place of $, for k G N sufficiently large, a suitable choice of Co > 0 in 
place of C (depending on k), and Vq < 0 sufficiently close to zero. 

Observe that 0 o a o 4/ ( W cs n U) (respectively, 0 o a o ty(W cs DC/)) is tangent to 
the cone 0oao'|/(S o nt/) along the positive y (respectively, the positive z) axis. 
Thus for every e > 0 and sufficiently small neighborhood U (depending on e), we 
can construct a diffeomorphism : 0oaoT(f7) —> R 3 mapping <doao'£(W cs HU) 
(respectively, 0 o a o ty(W cu D U)) into the xy (respectively, the xz) plane, with 
||<& € — Id|| C i < e (here Id denotes the identity map, and ||-|| C i is the C 1 norm). 
Then, for sufficiently small e > 0, (l)-(3) hold with $ = $ f o0 oaof and A/" the 
interior of <l> e (A4), with suitably chosen C > C 0 and V 0 < 0. □ 

In what follows, J\f, U, and $ are as in Lemma 2.24. We continue to denote 
by Q the pushforward of the Fibonacci trace map T by $ in the neighborhood U 
(and, as above, Qv denotes the pushforward of Ty). Implicit in this notation is the 
dependence on the choice of 8 in the statement of Lemma 2.24. In what follows, 
we choose 8 = 5 radians. 

Remark 2.25. Notice that by construction, J\f is a fundamental domain. More 
precisely, if p € 4>(f7) \J\f with p y > p z , and for some k £ N, G k (p) G $(£/) \ J\T 
with G k {p) z > G k (p) v , then for some n G {1,..., k}, G n (p) G A f. 

Lemma 2.26. There exists an open neighborhood O of Pi with O C U, such that 
the following holds. 

Let l s and l u be points on the positive y and the positive z axis, respectively, in 
$(0). For all N G N there exists Vq < 0 (which depends on N) and m G N (which 
does not depend on N) such that for all V G (Vo,0) andp G ^(OnSy) withp z < l u , 
p y > l s , and p z < p y , there exists h = h(p) G N such that 

(1) G n \p)z > lu and for all n G {1,..., n}, G n (p) G $([/). 

(2) There exist n*,n* G {1 1 < n* < n* < h, such that for all 

n G {n*,..., n*}, G n (p) G A f, and for all n G {n* + 1,... ,n} and n G 
{!,•••,«*- 1}, G n {p) iN. 

(3) For all n G {n* + 1,..., h} (respectively, n G {1,..., n* — 1}), G n (p)z > 
G n * (p) y (respectively, G n (p) y > G n \p) z )- 

(4) With k as in the proof of Lemma 2.24 (with 8 = | as above), we have 
2 k — 1 < n* — n* < 2 k. 

(5) h — n* < m + n* (and, similarly, n* < h — n* + m). 

(6) h — n* > N. 
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Proof. With O initially chosen sufficiently small, (1) follows from (20) and the C 1 
closeness of Q to DQ 0 . By Remark 2.25 and the construction of A f (see the proof 
of Lemma 2.24), (2), (3) and (4) follow. 

Let us record, for ease of reference, the following simple fact. 

Claim 2.27. There exists Cq > 0 such that the following holds. Suppose 7 is a 
compact smooth regular curve in 4>(f7) with the endpoints p and q. Suppose p lies 
in the xz plane (respectively, the xy plane), and q does not. Suppose further that 
the tangent vector at every point r of 7 belongs to the cone K(^ 2 (r) (respectively, 
K ^/2 (r)) from (32). Then, denoting by d the distance from q to the xz plane 
(respectively, the xy plane) and by l the length of 7 , we have ( d/l ) ±:L < Cq. 


Proof. Let (3 denote the line segment connecting p and q. Since the tangent space 
of 7 lies inside the cone field ATjW or Ky 2 , (o?// 3 ) =fcl is bounded independently of 

7. Thus it is enough to prove existence of a constant C 0 > 0 independent of 7 such 
that (f 3 /l) ±l < C 0 . 

Let us introduce an orthogonal coordinate system (27, X2, £3) with its origin at 
p such that (3 lies along the positive 27 axis, so that p and q lie on the 27 axis, with 
p at the origin. Write q± for q measured along the 37 axis. Thus the length of (3 is 
<?i- 

Then 27 lies inside of the cone field. In this coordinate system, write 71(f) for the 
component of 7 (t) along the 27 axis, parameterized, say, on [ 0 , 1 ]. By regularity, 
if 7i(f) = 0 then ^(27,7'(f)) = n/2, which violates the cone condition. Thus for 
all t, 7((f) 7^ 0, and we may reparameterize 7 along 07, that is, we may write 
7(0 = (L 72(f), 73(f))- 

We have 1 7' (i) | = tand, where 9 is the angle between 27 and the projection of 
7'(f) into the (27,27) plane. Because the cone field is of size 1/2 < 1, there exists 
6 £ (0,7t/2) independent of 7 such that for all t, 1 7'- (t) | < tan 0 . Now we have 

1 = [ W'y'{t)\\ dt < f y 17) (t) | dt < qi(l + 2 tang). 

Jo Jo j 

The result follows with C 0 = 1 + 2 tand. □ 


Suppose that p £ M such that p y < l s and p z < l 
are the smallest natural numbers such that Q - yy/z » ‘ \njy 

Then (5) would follow if we could demonstrate existence of a universal upper bound 


Assume that , n^ £ N 

(pU \p)z > L and Q~ np \p) y > l s - 


» 


(i.e. independent of all V < 0 sufficiently close to zero and p £ A") on n y ' — n 
Let (3 S (respectively, (3 U ) be the shortest line segments connecting p and the 
xz (respectively, the xy) plane. Let us denote by dist(p, xy) and dist(p, xz) the 
distance from the point p to the xy and the xz planes, respectively. Clearly there 
exists a universal constant C\ > 0 such that 


f dist(g n p 3 ) (p) y , 2 :z) \ < 

\ dist (g nipL) (p) z ,xy) J 


Observe that /3 S and /3 U fall inside the cone fields Ky 2 and A/', 2 , respectively. 
We may assume that these two cone fields are invariant under DQ and DQ -1 , 
respectively, by taking smaller U to begin with. 
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By the invariance of the cone fields KC 2 and A“, 2 , we see that for every point 
r on the curve Q~ n p } (fl s ), the tangent vector to the curve at r belongs to KC 2 (r); 
similarly for fl u with n^ in place of —n^ and K^ 2 (r) in place of K^ 2 (r). Now 
using Claim 2.27, with Co as in the claim, we get 


flen(g n p\l3 S )) 


±1 


(42) I (,) 

V len (Q n r (]3 U )) 

where len(-) denotes the length of a curve. 

Let us assume that rip > n.p U) . We have 

len^-^ftj^len^"? 0 - 


< CiCo, 




°g- 




(&))• 


Since we have Ky 2 C K{ and A“/ 2 C AT“, Lemma 2.20 is applicable with Ad /2 in 

place of K\. So by Lemma 2.20 (1), there exists a universal constant A > 1 such 
that 


(43) 


len(f7 




o g- 


^ (As)) > A< s> - 




(«) , 


p len(t/ n p (As)). 


Now with D as in Lemma 2.20 (3), from (42), (43), and Lemma 2.20 (3) we obtain 


'„w_ n w len (fl s ) 

len(fl u ) 


< DC\Co 


Now with C as in (2) of Lemma 2.24, from Lemma 2.24 and the above inequality 
we get 


< CDCiCq. 


This gives a universal upper bound on rip S — n^ in case n.p^ . The case 

n'p' 1 < n is handled similarly. This proves (5). 

Finally, (6) follows easily since the neighborhood AT D $(Sy) approaches the 
origin in the Hausdorff metric as V —► 0. □ 


We are now ready to prove the main result of Step (3), namely, with the notation 
from Proposition 2.19, we have 

Proposition 2.28. For every A > 0 there exists e = e(A) > 0 such that the 
following holds. For allV <0 sufficiently close to zero, let Ay j£ be the continuation 
of Y e from So to Sy as in Section 2.2. There exists Vo < 0 depending on e that 
satisfies the conclusion of Proposition 2.19 with some fixed S u > 0, and we have the 
following. 

For all V £ (Vo, 0) let 7 y >e denote the curve of tangencies on <f>(Sy) that has been 
constructed in Step (2), such that with M| s v and k = k(V) as in Proposition 2.19, 
G~ k (lv,e) li es in v ; denote by Cy e and Cy e the sets formed by intersections 
of lv,e with the stable and the unstable laminations o/$(Ay e ), respectively. Then 
Cy e and Cy e are nonempty Cantor sets, Cy e does not fall entirely into a gap of 
Cy e , and r(Cy f),T(Cy e ) > A (where t is the thickness). 

In the proof of the proposition, we use the notation from Steps (1) and (2). 


Proof of Proposition 2.28. That for all e > 0 sufficiently small and for all V < 0 
sufficiently close to zero, Cy e and Cy e are nonempty Cantor sets and one does not 
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fall into a gap of the other follows by construction of 7 y e (indeed, recall that Mf, v 
is a fundamental domain). 

Fix A > 0 and S, 5 U > 0 with S u £ (0,(5) as in Proposition 2.16. Fix e > 0 
so small, that when the stable lamination of <V(Ao !£ ) is orthogonally projected via 
Py 1 into Bg, its intersection with the z axis forms a Cantor set of thickness larger 
than A. Indeed, this is possible due to Lemma 2.1 with the observation that since *I> 
is a diffeomorphism, and in particular <P and d > _1 are both Lipschitz, the distortion 
of the thickness under the action by $ is bounded by multiplication by a constant. 

Lemma 2.29. Denote by Wy e the image of the stable lamination o/ < h(Ay j(r ) under 
Py -1 . There exists e > 0, Vo < 0, and 5 U £ (0,(5) sufficiently small, such that for 
all V £ (Vo,0) the following holds. Assume that 7 is a compact curve in B$ u v 
such that the distance from Py _ 1 ( 7 ) to the z axis in the C 1 topology is not larger 
than e. Then 7 intersects P y(Wy e ) transversally in a Cantor set whose thickness 
is larger than A. 

Proof. That, given the assumptions with e > 0 sufficiently small and Vq sufficiently 
close to zero, 7 intersects P yfWve) transversally is obvious since Wy e intersects 
the z axis transversally. Let us prove that this intersection forms a Cantor set of 
thickness larger than A (possibly taking e and taking Vq closer to zero as necessary). 

By assumptions (the paragraph preceding the statement of Lemma 2.29) the 
intersection of Wq e with the z axis forms a Cantor set of thickness larger than A. 
On the other hand, the thickness of the intersection of Wy e with the z axis varies 
continuously in V (see Theorem 2 in Chapter 4 of [61]). It follows that for all V < 0 
sufficiently close to zero, the thickness of the intersection of Wy e with the z axis is 
also larger than A. 

Now view Wy e as a sublamination of Py~ 1 (By). For any V < 0 sufficiently 
close to zero and any curve 7 in Pf / _ 1 (I3| U v ) sufficiently close to the z axis in the 
C 1 topology, the intersection of 7 with Wy e can be viewed as the C 1 image of the 
intersection of Wy e with the z axis under the holonomy map defined as projection 
along the foliation Py~ 1 (By). Moreover, the foliation By can be constructed in 
such a way as to depend continuously in the C 1 topology on V (hence Py~ (By) 
also depends continuously on V in the C 1 topology); see Theorem 8 in Appendix 1 
of [61]. It follows that for all L > 1 there exist e > 0 and Vo < 0 such that for all 
V £ (Vo,0) and every 7 in Py. _ 1 (.B| u v ) e-close to the z axis in the C 1 topology, 
the holonomy map along P y~ (By) from 7 to the z axis, as well as its inverse, are 
Lipschitz with a Lipschitz constant L. 

Now taking L above sufficiently close to one, we can make sure that the thickness 
of the intersection of 7 with Wy e is also larger than A. Finally, projection of 7 by 
Py does not destroy these bounds provided that V < 0 and S u > 0 are sufficiently 
close to zero (so that Py is close in the C 1 topology to the identity map). □ 

We wish to apply Lemma 2.29 with 7 = 7 y >e . For this we need to make sure 
that as V —> 0, 7 y e approaches the z axis in the C 1 topology. This is done in the 
next lemma. 

Lemma 2.30. With 7 y £ as in the statement of Proposition 2.28, 7 y >e approaches 
the z axis in the C 1 topology as V -7-0. 
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Proof. Fix e > 0 arbitrarily small. It is enough to show that there exists Vo < 0 
sufficiently close to zero, such that for all V £ (Vo, 0), 7 y, e is e-close to the z axis in 
the C° topology, and the tangent space of falls inside the cone field Kf from 
(32). 

That for all V < 0 sufficiently close to zero, 7 y e is e-close to the 2 axis in the 
C° topology follows from (the proof of) Lemma 2.17. 

Observe that for all e > 0 there exists a tubular neighborhood of the positive 
z axis, call it 7g, such that for all x £ 7g, DQ{K~(x)) C K~(G(x)). Indeed, this 
follows easily by continuity (the positive z axis is invariant under Q and DQ and we 
have (20)). Now, to finish the proof, let us show that for all V < 0 sufficiently close 
to zero, there exists n* £ N, n* < k (here k is as in the statement of Proposition 
2.28), such that for all n £ { 0 ,..., n*}, G~ n {Tv,e) lies in 7g, and the tangent space 
of DQ~ n ('lv,e) f a ll s inside the cone field Kf. 

Observe, again by (the proof of) Lemma 2.17 that given any n* £ N, n* < k , for 
all V < 0 sufficiently close to zero and for all n £ {0,..., n*}, G~ n { 7y, e ) indeed lies 
in 7g. On the other hand, given 5 > 0, there exists n* £ N, n* < k, such that for 
all V < 0 sufficiently close to zero, the orthogonal projection into the xz plane of 
every leaf of G~ n (fFy) is (5-close to the horizontal in the C 1 topology, which follows 
from Proposition 2.6. But then given an arbitrarily small 9 £ (0, |), we can choose 
S > 0 sufficiently small and n* as above, such that for all V < 0 sufficiently close 
to zero, the orthogonal projection of G~ n ( 7 y j£ ) into the xz plane makes the angle 
with the horizontal of at least ^ — 9 radians (this can be shown using exactly the 
same argument as in Section 2.3.3, particularly Claim 2.12). Finally, we can choose 
71 sufficiently small above to begin with, such that for all V < 0 sufficiently close 
to zero, the vectors tangent to G~ n ( 7 y, e ) make the angle of at most 9 degrees with 
the xz plane (this follows since away from the singularities, $(Sy) tends to <V(S 0 ) 
in the C 2 topology as V tends to zero). Thus, provided that we take 6 > 0 and 
9 £ (0, |) sufficiently small, there exists n* £ N, n* < k, such that for all V < 0 
sufficiently small the tangent space of Q~ n ( r yv >e ) falls inside the cone field K~, and, 
from the previous paragraph, for all n £ {0,..., n*}, G~ n (jv,e) lies in 7g. □ 

Thus we see that there exists e > 0 such that for all V < 0 sufficiently close to 
zero, r(Cy e ) > A. Next we show that e > 0 can be chosen sufficiently small, such 
that for all V < 0 sufficiently close to zero, r(Cy e ) > A. 

Fix A > A. With k = k(V) as above, so that G~ k ( 7 v,e) lies in M|', v , observe 
that by the same arguments as above we can choose e > 0 sufficiently small such 
that for all V <0 sufficiently close to zero, the thickness of Cy e = f G~ k (Cy e ) is 
larger than A. Let us prove that with A sufficiently large, for all e > 0 sufficiently 
small and all V < 0 sufficiently close to zero, the thickness of G k {Cyf) is larger 
than A. To control the distortion of the thickness under the action by G, we use 
the bounded distortion property from Lemmas 2.20 and 2.26. 

Let O be as in Lemma 2.26. We may assume that Mg, v and G k {Mgs v ) lie in O 
and, by Lemma 2.26, for all n £ {1,..., k} and every point p of 7 y >€ , G~ n {p ) £ U. 

Lemma 2.31. For all V < 0 sufficiently close to zero the following holds. 

Take a point p = p(V) in G~ k (Tv,t)- Let n * = n*(p) £ N and n* = n*{p) £ N 
be such that G n * +1 (p) £ A/", G n *~ 1 {p) £ A/", G n ’(p ) ^ A/ - , and G n * (p) ^ A/ - ; here J\f 
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is as in Lemma 2.26. Let u = u{p) be the unit tangent vector to Q fc (7v,e) at. the 
point p. Then DQ n *{u) G Kf (Q n * (p)) and DQ n (it) G K™(G n ( p )). 

Proof. Let us prove that DQ n ( u ) G Kf(Q n (p)). Since we are working under the 
assumption that for all p G <&(Z7 n Sy) \ N with p z > p y , the tangent plane to 
$(§ 1 /) at p makes the angle of at most f. radians with the xz plane, there exists 
e > 0 such that if the orthogonal projection of DQ n (it) into the xz plane makes 
the angle of at most e radians with the z axis, then DQ n (it) G K^{Q n (p)). 

Observe that the leaf of the stable foliation which intersects Q n ~ k ('yv,e) in the 
point Q n (p) can be ensured to be arbitrarily close to the horizontal in the C 1 
topology, by ensuring that Q n ( p) z is sufficiently small (see Proposition 2.6), which 
can in turn be ensured for all V < 0 sufficiently close to zero. Also, the leaf of the 
unstable foliation that intersects Q n ~ k ( , Jv,e) in the point Q n (p), and is tangent to 
the leaf of the stable foliation at that point, can be ensured to have an arbitrarily 
large curvature in the point Q n ( p ) by ensuring that n* is sufficiently large, which 
can again be ensured for all V < 0 sufficiently close to zero (see Section 2.3.2). 
Thus, employing Claim 2.12 we can ensure, for all V < 0 sufficiently close to zero, 
that DQ n (it) projects onto a vector in the xz plane that makes the angle of at 
most e radians with the vertical. 

The case of n* and K]‘ in place of n* and Kf , respectively, is handeled similarly. 

□ 


We can now conclude the proof of the proposition by employing Lemma 2.26 
together with Lemma 2.20. Observe that for p a point on the curve Q~ k ( 7 y, e ), the 
orbit [p, G(p), ■ ■ ■, G k {p)} is broken into 

{p,g(p),...,0"*(p)}c<l>(Svnf7)\AA, 

{^*(p),...,5 fc (p)}c<i>(§vn[/)\AA, 

and 

{s”* +1 0p), •. • ,G n *-\p)} cAfn <&(Sy n U), 

such that, by Lemma 2.26, n* — n* and |(fc — n*) — n*| are bounded uniformly, 
independently of V and p, although k depends on V (the k here is of course different 
from the k in the statement of Lemma 2.26). Now, by Lemma 2.20, there exists a 
universal constant D , independent of V and p , such that for u as in the statement 
of Lemma 2.31, we have 

/|| W fc -"*( zi ^*( ii ))||\ ±1 ^ /|| W "*( w )||\ ±1 
\\\Dg-™*{Dg™*(u))\\) ~ \j|DS"-(u )||) ’ 


and obviously the right side of the above inequality is universally bounded since 
n* — n* is. It follows that 


^ IMI ) 


Dg k (u ) 


is universally bounded. From this, we obtain a universal bound on 
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Thus, we indeed can choose A > 0 sufficiently large, such that if r(Cy e ) > A, then 
T(C$, e ) > A. ' □ 

This completes Step (3). □ 

Step (4)- This follows immediately from Step (3) and the Gap Lemma of S. New- 
house (see the proof of Lemma 4 in [58]). □ 

Step (5). This follows from the previous steps, noting that there exist periodic 
points the stable and the unstable manifolds of which are dense in the stable and 
the unstable laminations, respectively (see [61, Appendix 1]) □ 

2.4. Proof of Theorem 1.1, (5), (6), and (7). Recall that, given a diffeomor- 
phism / of a compact two-dimensional manifold and a hyperbolic saddle P of /, 
the homoclinic class H (P, /) is defined to be the closure of the union of all the 
transversal homoclinic points of P. Also recall that H(P, f) is /-invariant and 
transitive (see [39]). 

The statements (5), (6) and (7) of Theorem 1.1 follow from [39, Theorem 4], 
Namely, as part of Theorem 4 in [39], we have 

Theorem 2.32 (Gorodetski 2012). Let fo be a C°° area preserving diffeomorphism 
of a compact two-dimensional manifold M with an orbit O of quadratic homoclinic 
tangencies associated to some hyperbolic fixed point P 0 , and {/ M } be a generic un¬ 
folding of /o along the parameter p. Then for any S > 0 there is an open set 
U Cl 1 , 0 CW, such that the following holds. 

There is a residual subset TZ C U such that for every p £ TZ, 

(1) the homoclinic class H (P^, f^) is accumulated by f^ ’s generic elliptic points, 

(2) the homoclinic class H(P^,f^) contains hyperbolic sets of Hausdorff di¬ 
mension arbitrarily close to 2; in particular, the Hausdorff dimension of 
H(P lx ,f fx ) is equal to 2. 

Clearly the fixed point Po and its continuation {P M } can be replaced by a periodic 
point and, respectively, its continuation along the parameter p. 

Now, in the notation of Theorem 2.32, we can take U = (Vo,0), where Vq < 0 
is sufficiently close to zero such that Theorem 1.1 (l)-(4) hold, p = V, = T v , 
and Pq = Py , V' £ (Vo,0) (and its continuation {Pv}ve(v 0 o)) a P er i°dic point 
exhibiting a homoclinic tangency. Then Theorem 2.32 (1) gives Theorem 1.1 (5) 
and (7), and Theorem 2.32 (2) gives Theorem 1.1 (6). 
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